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Abstract 

This  thesis  addresses  two  primary  concerns  relating  to  Directed  Energy  (DE) 
models  and  tests:  need  for  more  use  of  Design  of  Experiment  (DOE)  in  structuring 
DE  models  and  tests,  and  lack  of  modeling  atmospheric  variability  in  High  Energy 
Laser  (HEL)  weapon  system  propagation  models  and  tests.  To  address  these 
concerns  we  use  a  DOE  factorial  design  to  capture  main,  interaction,  and  non-linear 
effects  between  modeled  weapon  design  and  environmental  factors  in  a  well  defined 
simulated  Air-to-Ground  HEL  engagement  scenario.  The  scenario  modeled 
considers  a  Bl-B  aircraft  in  the  2022  timeframe  equipped  with  an  HEL  weapon, 
irradiating  a  ground  target  from  30K  feet  altitude.  The  High  Energy  Laser  End-to- 
End  Operational  Simulation  (HELEEOS),  developed  by  the  AFIT  Center  for 
Directed  Energy  (CDE),  is  used  to  model  HEL  propagation.  Atmospheric  variability 
is  incorporated  by  using  input  from  the  Laser  Environmental  Effects  Definition  and 
Reference  (LEEDER)  model  based  on  randomly  selected  daily  meteorological  data 
(METAR)  for  a  specific  geographic  location.  Results  clearly  indicate  the  practical 
significance  of  a  number  of  HEL  weapon  design  and  environmental  factors,  to 
include  a  number  of  previously  unidentified  interactions  and  non-linear  effects,  on 
the  final  energy  delivered  to  a  target  for  our  modeled  scenario. 
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MODELING  AND  ANALYSIS  HIGH  ENERGY  LASER  WEAPON  SYSTEM 
PERFORMANCE  IN  VARYING  ATMOSPHERIC  CONDITIONS 

I.  Introduction 

1.1  Background  &  Problem  Significance 

The  Air  Force  has  been  leading  the  development  of  high  energy  laser  (HEL) 
science  and  technology  for  aircraft  applications  since  the  early  1970’s.  Three  Air 
Force  programs  have  attempted  to  integrated  HEL  weapons  into  aircraft.  The  first 
was  the  Airborne  Laser  Laboratory  (ALL),  integrating  a  Chemical  Oxygen  Iodine 
Laser  (COIL)  Laser  which  demonstrated  shoot  down  of  AMRAAM  missiles.  The 
second  was  the  Airborne  Laser  (ABL)  Program,  integrating  an  HEL  onto  a  Boeing 
747  designed  to  shoot  down  Theater  Ballistic  Missiles.  The  third  was  the  Air 
Tactical  Laser  (ATL),  integrating  an  HEL  into  a  C-130  designed  to  negate  moving 
ground  vehicles.  Although  the  performance  of  these  laser  weapon  systems  did  not 
meet  Air  force  expectations,  they  did  advance  the  technology  into  higher  maturity 
levels. 

Aside  from  design  and  engineering  hurtles  still  to  overcome  with  integrating 
HEL  weapons  into  aircraft,  a  bigger  scientific  challenge  the  US  Air  Force  will  face 
in  the  very  near  future  is  how  to  improve  or  simply  maintain  laser  beam  propagation 
through  the  atmosphere  given  varying  weather  conditions.  The  Government 
Accounting  Office  recognizes  that  atmospheric  compensation  for  the  airborne  laser 
is  a  critical  program  risk  element.  (Committees  March,  2005). 

Atmospheric  interferences  come  in  many  forms,  but  physicists  have 
narrowed  the  most  influential  to  that  of  turbulence,  atmospheric  absorption,  and 
scattering  (Perram  et  al.,  2010).  These  atmospheric  effects  can  significantly  degrade 
a  laser  beam,  sometimes  diminishing  all  of  its  intensity  by  mid-propagation,  keeping 
it  from  reaching  its  intended  target. 

To  mitigate  the  effect  of  atmospheric  interferences,  three  key  considerations 
are  made:  select  laser  designs  with  power,  wavelength,  aperture,  and  beam  quality 
settings  which  best  propagate  through  the  atmosphere;  determine  ideal  engagement 
geometries  between  the  aircraft  and  the  target;  improve  predictive  laser  system 
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performance  abilities  by  developing  a  process  which  models  atmospheric  variations 
that  emulate  relevant  environments  for  testing  or  operations. 

To  determine  the  best  performing  HEL  weapon  system  designs  and 
engagement  geometries  for  atmospheric  propagation,  there  must  be  a  method  to 
objectively  capture,  compare,  and  isolate  the  effects  of  the  system’s  performance 
parameters  despite  atmospheric  influences  being  present.  Current  HEL  modeling 
and  test  practices  have  documented  very  little  on  this  concept.  Isolation  of  cause  and 
effect  relationships  becomes  more  difficult  when  random,  uncontrolled,  varying 
parameters  exist  which  vary  performance  outcomes.  Having  random  variables  in  any 
test  can  degrade  performance,  or  some  cases  enhance  performance,  making  it  hard  to 
differentiate  between  a  performance  outcome  due  to  interferences,  parameter 
settings,  or  a  combination  of  both.  Design  of  Experiments  and  Response  Surface 
Methodology  are  two  statistical  techniques  appropriate  to  track  traceability  between 
cause  and  effect  relationships  of  an  outcome.  These  two  methodologies  are 
incorporated  in  this  research. 

1.11  Introduction  to  High  Energy  Lasers 

Laser  development  started  back  in  the  early  60’s.  “Laser”  comes  from  the 
acronym  Light  Amplification  by  Stimulated  Emission  of  Radiation  (LASER). 
Stimulated  emission  occurs  when  light  or  electricity  is  pumped  into  a  lasing  medium 
which  excites  atoms,  causing  them  to  lose  an  electron.  The  electron  is  pumped  into  a 
higher  state,  and  when  it  drops  back  down  to  its  ground  state,  it  emits  a  photon, 
creating  a  coherent  electro-magnetic  energy.  The  photons  are  channeled  through  a 
beam  control  system  and  focused  onto  a  spot  which  projects  a  consolidated  and  tight 
laser  beam  through  a  beam  director,  which  focuses  and  magnifies  the  intensity  of  the 
beam  as  it  exits  the  laser  weapon  system.  By  Department  of  Defense  classification,  a 
high  powered  laser  is  one  in  which  the  output  power  exceeds  25  kilowatts 
(Anderberg  and  Wolbursht,  1992).  The  output  intensity  of  a  laser  depends  on  several 
factors,  such  as  the  laser  weapon’s  sub-system  configuration  and  characteristics. 
Laser  weapons  typically  have  four  sub-systems:  beam  control,  the  laser  itself, 
system  control,  and  thermal  management.  Some  of  the  characteristics  of  a  laser 
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weapon  are  its  wavelength,  power  level,  aperture  mirror  size,  and  beam  quality.  All 
of  these  factors  play  a  role  in  the  intensity  of  output  power.  The  most  common  types 
of  lasers  built  today  are  COIL,  Fiber,  Free  Electron,  and  Solid  State.  Aside  from 
sub-system  design  differences,  the  primary  difference  in  the  performance  of  these 
laser  types  is  attributed  to  differences  in  laser  beam  wavelengths. 

If  successfully  designed,  engineered,  tested,  and  deployed,  HEL  weapon 
systems  could  be  highly  efficient  in  defending  against  or  attacking  a  large  class  of 
target  types,  provided  sufficient  atmospheric  conditions  exist.  HEL  weapons  have 
the  potential  to  hit  targets  beyond  the  range  of  any  Air-to-Air  or  Air-to-Ground 
weapon  in  inventory  to  date.  No  other  weapon  can  travel  at  the  speed  of  light,  with 
ultra-precision  strike  capabilities,  then  immediately  re-target  and  engage  another 
target,  all  with  having  no  signature  trace,  and  executed  with  minimal  collateral 
damage.  Unlike  conventional  weapons,  HEL  weapons  can  have  an  unlimited 
magazine,  enabling  it  to  fire  for  long  durations.  When  deployed  in  the  field,  the  hope 
is  HEL  weapon  systems  will  defend  against  UAVs,  cruise  missiles,  aircraft, 
optics/sensors,  ballistic  missiles,  and  surface-to-air  munitions  (Souder  and  Langille, 
2004).  Having  an  airborne  weapon  of  this  caliber  would  change  air  warfare. 

1.12  High  Energy  Laser  Performance  Modeling 

There  are  three  primary  HEL  scaling  law  codes  used  by  the  Air  Force 
Research  Lab’s  Directed  Energy  Directorate  for  modeling  laser  propagation  for  laser 
to  target  Air-to-Air,  Air-to-Ground,  and  Ground-to-Ground  engagement  scenarios. 
These  codes  are  the  High-Energy  Laser  Consolidating  Modeling  Engagement 
Simulation  (HELCOMES),  High  Energy  Laser  End-to-End  Operational  Simulation 
(HELEEOS),  and  Scaling  for  HEL  and  Relay  engagement  (SHaRE).  Each  is 
anchored  to  wave-optics  codes,  which  are  based  on  actual  collected  atmospheric 
observations  and  very  high  fidelity  physics  models.  These  scaling  codes  are  all 
system-level  codes,  which  means  sub-system  components  (beam  control,  thermal 
management,  etc.)  are  not  modeled.  The  models  only  capture  the  laser  beam  as  it 
leaves  the  aperture  mirror  and  propagates  through  the  atmosphere.  The  codes 
calculate  a  variety  of  outputs,  one  of  which  is  the  intensity,  or  irradiance  (watts/cm2) 
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delivered  on  a  spot.  Irradiance,  discussed  in  section  2.15,  is  a  function  of  the  user- 
defined  inputs  for  the  laser  characteristics  as  well  as  any  nuisance  factors  that  reduce 
the  intensity  of  the  beam  as  it  propagates.  Analysts  take  irradiance  outputs  from  the 
HEL  scaling  codes  and  compare  them  to  actual  target  vulnerability  criteria,  enabling 
them  to  equate  irradiance  to  an  achieved  level  of  damage  to  a  target.  Although  the 
scaling  codes  are  not  as  accurate  as  the  wave  optics  codes,  (by  approximately  +/- 
10%),  they  are  faster,  and  less  complicated  to  use  than  wave  optics  codes,  making  it 
more  convenient  for  running  large  trade-space  analysis  with  multiple  scenarios  and 
getting  results  quickly.  The  scaling  code  used  for  this  thesis  is  HELEEOS  3.0,  which 
is  discussed  in  section  2.14. 

1.13  Current  High  Energy  Laser  Test  Practices 
HEL  tests  conducted  by  the  Air  Force  Research  Lab’s  Directed  Energy 
Directorate  consist  of  Ground-to-Ground  scenarios  using  a  horizontal  path 
propagation.  Typically  these  laser- to-target  engagements  are  at  fairly  short 
engagement  distances  (i.e.,  <2  miles).  After  looking  through  previous  DE  program 
test  evaluation  master  plans,  it  does  not  appear  that  a  design  of  experiment  (DOE) 
methodology  has  been  employed.  This  thesis  demonstrates  the  benefits  gained  by 
applying  DOE  to  both  HEL  modeling,  and  by  inference,  designing  a  live  test. 

1.2  Problem  Statement 

The  problem  addressed  in  this  thesis  decomposes  into  two  sub-problems. 

Sub-Problem  1:  Limitations  of  current  HEL  engagement  models.  The  HEL 
performance  models  currently  used  by  the  DoD  Modeling  &  Simulation  community 
are  very  capable  and  useful  in  the  conceptual  design  phase  of  an  HEL  weapon 
system.  However,  they  are  all  deterministic,  which  assumes  away  all  variations  and 
experimental  error  that  would  be  present  in  any  real  test  demonstration. 

Sub-Problem  2:  The  absence  of  DOE  application  in  current  airborne  HEL 
Testing.  Although  there  have  been  air-to-ground  test  demonstrations  where  airborne 
HEL  weapons  have  achieved  desired  damage  to  targets,  there  has  not  been  extensive 
application  or  analysis  using  DOE  methodology.  Without  the  application  of  DOE 
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techniques,  such  as  use  of  replications,  random  order  combinations,  and  blocking 
techniques,  test  design  may  not  capture  the  full  spectrum  of  valuable  information 
which  could  be  extracted  from  each  test,  such  as  insights  to  performance 
improvements.  Tests  can  be  expensive,  with  limited  range  time  and  human 
resources,  thus  it  is  important  each  test  be  strategically  planned  with  a  purpose  and 
efficiency.  In  addition,  without  use  of  DOE,  there  is  an  increased  probability  of 
introducing  a  systematic  bias  and/or  experimental  error  caused  by  the  experimental 
sequence  itself,  making  it  impossible  to  distinguish  between  impacts  caused  by 
random  error  and  those  of  the  actual  system. 

1.3  Problem  Approach  and  Scope 

Since  it  is  not  possible  to  conduct  actual  airborne  HEL  testing  to  support  this 
thesis,  modeling  and  simulation  is  used.  The  scenario  modeled  for  this  research  is  an 
Air-to-Ground  HEL  engagement  between  an  airborne  Bl-B  aircraft  and  a  truck,  set 
in  the  2022  timeframe.  Two  models  are  used  to  simulate  this  engagement,  an 
atmospheric  model  called  Laser  Environmental  Effects  Definition  and  Reference 
(LEEDR) ,  and  the  HELEEOS  HEL  propagation  model.  Typical  modelers  of  HEL 
engagements  use  HEL  engagement  models  as  an  all-in-one  model,  letting  the  model 
calculate  its  own  atmospheric  effects  via  algorithms  for  turbulence  and  extinction. 
Algorithms  are  an  excellent  way  to  supplement  for  not  having  actual  atmospheric 
data,  allow  for  the  models  to  run  quickly,  and  provide  a  rough  idea  of  HEL 
performance  for  large  trade-studies  with  the  objective  to  compare  system  designs. 
However,  a  major  disadvantage  to  using  algorithms  is  that  all  outputs  of  HELEEOS 
as  a  stand-alone  model  are  deterministic.  This  means  the  atmosphere  remains 
constant  among  runs;  there  are  no  random  variations  modeled  in  the  atmosphere.  To 
incorporate  varying  atmospheric  conditions,  LEEDR,  an  atmospheric  model,  is  used 
in  conjunction  with  HELEEOS.  LEEDR  takes  actual  atmospheric  observations  from 
a  geographic  location  on  the  earth’s  surface  and  then  interpolates  and  outputs 
atmospheric  conditions  for  the  troposphere  and  stratosphere.  These  atmospheric 
conditions  are  output  into  an  excel  file,  which  reflects  a  snapshot  of  the  atmosphere 
at  a  specific  time.  This  profile  is  then  imported  into  HELEEOS.  In  order  for  each  run 
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of  HELEEOS  to  have  a  different  atmospheric  snapshot,  a  new  LEEDR  profile  is 
created  and  imported  for  each  run.  Figure  1  displays  the  process  used  to  model 
atmospheric  variations  in  the  Air-to-Ground  Engagement. 
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Figure  1 :  Model  Process  for  an  Air-to-Ground  HEL  Engagement  Model 


Reflecting  actual  variations  in  weather  conditions  is  important  for  accurate 
modeling  of  a  real  life  HEL  engagement  scenario  or  test  demonstration.  In  practice, 
the  atmosphere  will  change,  and  our  performance  changes  as  a  result. 

Design  of  experiments  and  Response  Surface  Methodology  are  two  statistical 
approaches  used  in  this  research.  DOE  has  recently  been  introduced  into  the  test  and 
evaluation  community,  however  there  is  little  evidence  of  use  in  Directed  Energy 
testing,  or  even  Directed  Energy  HEL  modeling.  DOE  methods  establish  test  a 
design  which  enables  tractability  between  cause  and  effect  relationships  of  results 
captured.  Without  the  use  of  DOE,  nuisance  factors  present  may  limit  one’s  ability 
to  interpret  the  contribution  each  parameter  has  towards  engagement  performance. 
Response  Surface  Methodology  examines  the  surface  of  interactions  between 
parameters,  enabling  analyst  to  determine  the  best  settings  for  a  system  design, 
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minimize  the  variance  caused  by  nuisance  factors  we  cannot  control,  and  overall 
increase  probability  of  achieving  the  desired  intensity  on  target.  JMP  is  the  statistical 
tool  used  in  this  work. 

1.31  Objectives 

1 .  Introduce  atmospheric  variability  to  a  pre-existing  HEL  scaling  model  to  make  it 
representative  of  a  live  HEL  test.  Atmospheric  variability,  a  known  nuisance 
factor,  will  dilute  the  traceability  of  the  impact  caused  by  controlled  factors  in  the 
test. 

2.  Apply  Design  of  Experiment  (DOE)  methodology  to  create  an  experimental 
design  that  will  enable  one  to  isolate  the  effects  of  the  controlled  parameters, 
despite  error  and  nuisance  factors  present. 

3.  Apply  Response  Surface  Methodology  (RSM)  to  determine  best  settings  for  an 
experimental  design,  and  extend  the  significance  of  that  design  to  the  Air-to- 
Ground  mission  scenario  defined  in  section  3.2. 

1.32  Assumptions 

Many  assumptions  have  been  made  to  frame  this  research.  Realistically,  there 
are  existing  sub-system  design  and  integration  complexities  still  to  overcome  with 
airborne  HEL  weapon  systems;  however  they  are  not  addressed  in  this  thesis.  This 
research  assumes  full  technology  maturity  for  all  system  designs  conceived,  even 
though  that  is  not  the  case.  The  laser  weapon  system  designs  considered  for  this 
research  are  presumed  to  exist  in  a  2022  timeframe.  This  thesis  is  based  upon 
modeling  and  simulation  only. 

1.4  Thesis  Overview 

Chapter  2,  Background  and  Literature  Review,  provides  an  introduction  to 
pertinent  concepts  and  terminology  applied  and  referenced  throughout  this  thesis. 
Addressed  are  fundamental  theories  of  the  atmosphere,  atmospheric  and  laser 
engagement  model  capabilities,  an  introduction  to  DOE  and  RSM,  and  a  brief 
overview  of  previous  case  studies  in  related  research.  Chapter  3,  Research 
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Methodology,  takes  the  methodologies  discussed  in  chapter  two  and  applies  them  to 
an  Air-to-Ground  laser  engagement  scenario  modeled  for  this  research.  This  chapter 
discusses  the  development  of  an  experimental  design,  implementation  of  model 
modifications  to  add  atmospheric  variability,  model  interactions,  and  method  in 
which  data  inputs  and  outputs  were  strategically  determined  in  a  pre-planning  phase. 
Chapter  4,  Results  and  Analysis,  takes  the  results  of  the  DOE  produced  using 
HELEEOS,  and  interprets  the  statistical  significance  of  the  response  as  a  function  of 
the  design  factors.  Chapter  5  concludes  this  thesis  and  takes  the  results  from  Chapter 
4  and  extends  them  to  a  broader  application  of  how  DOE  could  be  incorporated  into 
Directed  Energy  modeling  and  simulation,  as  well  as  testing.  Chapter  5  also 
provides  recommendations  for  future  research. 


II.  Background  &  Literature  Review 

This  chapter  introduces  literature,  concepts,  and  terminology  related  to  the  areas 
used  to  either  describe,  explain,  or  solve  the  problem  scenario  in  this  thesis. 
Atmospheric  modeling,  HEL  engagement  and  lethality  models,  DOE,  and  RSM  are 
the  areas  discussed  throughout  this  thesis.  Background  on  these  concepts  is 
important  for  comprehension  in  succeeding  chapters.  Case  studies  on  HEL  modeling 
and  analysis  are  also  discussed  to  provide  reference  and  insights  from  similar  studies 
to  this  research. 

2.1  Theories  of  the  Statistical  Atmosphere 

Despite  how  efficient  and  well  designed  laser  weapon  technology  becomes  in 
the  future,  performance  will  always  have  a  dependency  on  atmospheric  conditions, 
an  uncontrolled  factor.  Most  atmospheric  effects  are  likely  to  have  adverse  influence 
on  beam  path  propagation.  Inability  to  propagate  through  poor  atmospheric 
conditions  is  why  “all  weather  weapon”  does  not  apply  to  HEL  weapons.  Because  of 
this,  it  is  usually  assumed  that  lasers  will  be  used  in  combination  with  other 
weapons,  rather  than  as  a  stand-alone  offense  or  defense.  Interaction  effects  that 
exist  between  laser  beams  and  the  atmosphere  have  been  researched  extensively,  and 
several  books  have  been  published  on  this  topic  alone. 

Light  cannot  propagate  unless  it  has  a  medium  through  which  it  can  transmit. 

For  laser  beam  path  propagation,  the  atmosphere  is  the  medium,  and  the 
transmission  varies  through  each  layer  of  the  atmosphere.  The  interaction  between 
the  laser  and  atmosphere  is  at  a  molecular  level.  The  different  types  of  interactions 
are  due  in  part  from  temperature  differentials  encountered  when  traveling  through  a 
dynamic  atmosphere.  “In  terms  of  total  mass  and  effects  on  laser  weapon  systems, 
the  two  most  important  layers  of  the  atmosphere  are  the  troposphere  and 
stratosphere”  (Perram  et  al.,  2010).  Figure  2  below  displays  the  complex  layers  of 
the  atmosphere  and  classification  by  altitude  and  temperature. 
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Figure  2:  Diagram  Depicting  Various  Atmospheric  Layers  and  Air  Temperature 

(Andrews  and  Phillips,  2005) 

The  troposphere  is  the  lowest  portion  of  the  earth’s  atmosphere,  from  0-1 1 
km  in  altitude,  and  contains  the  majority  of  weather.  This  layer  is  harshest  on  laser 
beam  propagation,  and  is  often  called  the  “muck”  of  the  atmosphere.  Since  passing 
through  this  region  is  necessary  for  Air-to-Ground  and  Ground-to-Air  engagements, 
it  is  key  to  make  the  slant  range  through  this  atmospheric  layer  as  short  as  possible, 
i.e.  the  platform  and  target  90°  above  or  below  the  other.  The  stratosphere  is  the 
layer  above  the  troposphere,  20-40  km  in  altitude,  and  because  of  solar  radiation, 
temperatures  increase  with  altitude.  Temperature,  air  density,  water  vapors,  and 
pressure  all  change  from  day-to-day,  creating  different  conditions  in  the  layers  of  the 
atmosphere  at  any  given  point  in  time.  Since  laser  performance  is  highly  dependent 
on  these  conditions,  it  is  important  to  understand  laser  performance  not  only  in  good 
atmospheric  conditions,  but  also  in  bad. 

Out  of  all  factors  that  exist  in  the  atmosphere,  only  a  few  phenomena  have 
been  specifically  tied  to  having  a  significant  influence  on  laser  beam  propagation. 
Most  atmospheric  effects  on  laser  weapon  can  be  traced  to  three  atmospheric 
phenomena:  absorption  and  scattering,  (collectively  referred  to  as  extinction),  and 
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turbulence.  These  phenomena  listed  are  discussed  below,  as  well  as  their  effects 
incorporated  into  the  Air-to-Ground  HEL  engagement  modeled  for  this  research. 


2.11  Extinction 


Extinction  is  the  loss  of  electro-magnetic  energy  (i.e.  laser  wavelengths) 
along  a  path  through  a  medium  due  to  absorption  and  scattering.  Losses  due  to  all 
effects  is  attenuation.  Extinction  is  the  term  used  to  characterize  both  effects  of 
absorption  and  scattering,  which  are  both  measured  in  terms  of  percent  transmittance 
through  the  atmosphere,  relative  to  transmittance  through  a  vacuum. 

Absorption  refers  to  water  vapor  or  gas  molecules  in  the  atmosphere,  which 
absorb  heat  as  photons  pass  through  them.  “Transitions  that  occur  within  absorbing 
molecules  result  in  molecular  collisions. .  .[making]  the  medium  gain  thermal 
energy”  (Perram  et  al.,  2010).  This  reaction  causes  the  atmosphere  to  heat  up.  Since 
the  troposphere  contains  99%  of  all  water  vapor,  it  has  the  greatest  amount  of 
absorption.  Seasons  and  time  of  day  also  influence  absorption.  The  effect  of  laser 
transmission  caused  by  absorption,  Tabs,  can  be  calculated  using  equation  1. 
Absorption  is  a  function  of  wavelength,  A,  transmittance  intensity  with  absorption, 
l, a  (A),  transmittance  intensity  in  a  vacuum,  l0(A)  ,  the  absorption  cross  sectional  area 
in  m2,  (Ta/,s,  and  the  absorber  number  concentration  in  m'  along  the  transmission 
path,  Nz,  (Perram  at  el.,  2010): 


T  — 

J  abs 


ltA  (X)  _  e°absWXz 

■ 


(1) 


The  primary  issue  with  absorption  is  a  non-linear  effect  called  thermal 
blooming.  This  effect  produces  changes  in  air  density,  sometimes  warping  the  beam 
into  a  crescent  shape,  decreasing  the  intensity  of  the  center  of  the  beam.  Thermal 
blooming  is  highly  dependent  on  wavelength.  “Absorption  by  02  and  O3  essentially 
eliminates  propagation  of  radiation  at  wavelengths  below  0.2um,  but  there  is  very 
little  absorption  at  the  visible  wavelengths  (0.4  to  0.7  um)”  (Andrews  and  Phillips, 
2005).  When  selecting  a  laser  design  and  geometry,  it  is  important  to  understand 
atmospheric  effects  and  design  a  scenario  to  circumvent  the  likelihood  of  those 
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effects  influencing  performance.  Thermal  blooming  has  been  shown  to  “increase 
with  higher  laser  power,  higher  absorption,  longer  range  to  target,  smaller  (more 
focused  spot  size,  and  lower  wind  speed  or  slow  slew  rates”  (Perram  at  el.,  2010)). 
This  knowledge  can  be  useful  when  choosing  particular  power  levels,  ranges, 
wavelengths,  and  spot  sizes  to  circumvent  the  effects  of  absorption. 

The  other  type  of  extinction  is  atmospheric  scattering.  “Scattering  of 
electromagnetic  waves  in  the  visible  and  IR  wavelengths  occurs  when  the  radiation 
propagates  through  certain  air  molecules  and  particles”  (Andrews  and  Phillips., 
2005).  There  are  two  types  of  scattering,  Rayleigh’s  molecular  scattering  caused  by 
laser  photons  being  larger  than  the  air  molecules,  and  “Mie’s  aerosol  scattering, 
which  is  scattering  caused  by  laser  photons  being  smaller  than  particles”  (Andrews 
and  Phillips,  2005).  The  effect  of  laser  transmission  due  to  scattering,  Tsca,  can  be 
calculated  using  equation  2.  Scattering  is  a  function  of  wavelength,  A,  transmittance 
intensity  of  scattering,  lts(A),  transmittance  intensity  within  a  vacuum,  l0(/ l),  the 
transmission  path,  z,  and  the  scattering  coefficient,  as,  (Perram  at  el.,  2010): 


T  = 

““  W) 


=  e 


(2) 


2.12  Turbulence 

Turbulence,  denoted  Cn2,  is  a  result  of  random  temperature  differentials 
between  the  earth’s  surface  and  the  atmosphere.  Daytime  temperatures  produce 
negative  temperature  gradients,  which  bend  light  rays  upward,  and  night 
temperatures  produce  positive  temperature  gradients,  which  bend  light  dowward 
(Andrews  and  Phillips,  2005).  These  fluctuations  produce  variations  in  the  speed  in 
which  wavelength  propagates  (refractive  index),  and  cause  wave  front  distortions  in 
the  atmosphere  affecting  the  phase  of  light  when  a  laser  beam  passes  through  it. 
Refractive  index  is  based  upon  the  speed  at  which  a  wavelength  propogates  through 
the  atmosphere,  in  comparison  to  the  speed  at  which  light  travels.  Light  that  passes 
through  a  vacuum  would  have  an  index  refraction  of  1 .  As  a  wavelength  approaches 
the  earth  in  a  Air-to-Ground  scenario,  it  will  decrease  in  speed.  Ideally,  the 
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atmosphere  would  be  like  a  vacuum,  homogeneous,  with  no  variations,  allowing  a 
beam  to  propogate  without  any  loss  of  intensity.  We  use  the  term  defraction  limited 
to  describe  such  a  beam  with  no  degraded  effects.  Figure  3  shows  a  comparison  of  a 
difraction  limited  beam  to  that  of  a  degraded  beam  passing  through  the  atmosphere. 
The  downward  and  upward  gradients  shift  light. 


Vacuum  Atmosphere 


Figure  3:  Example  of  How  Variations  in  Refractive  Index  Affect  Phase  of  Light.  Note 
that  a  lower  n  implies  faster  propagation  speed  (Perram  at  el.,  2010) 

Other  distortions  caused  by  turbulence  include  aberations,  scintillation,  loss 
of  spactial  coherance,  beam  defocus,  or  beam  spread,  all  of  which  could  drastically 
degrade  a  propagating  beam,  thus  also  its  intenstiy  on  a  target.  Figure  4  depicts  the 
distortions  turbulence  has  on  a  beam.  The  circular  patterns  in  the  second  illustration 
of  Figure  4  represent  turbulent  eddies,  caused  by  density  variations.  These  desnity 
fluctuations  have  an  adverse  effect  on  laser  propagtion. 


Figure  4:  Example  of  How  Turbulence  Effects  the  Wavefront  of  Electromagnetic 

Energy  (Perram  at  el.,  2010) 

Overall  turbulence  and  scattering  effects  can  be  reduced  by  selecting 
appropriate  laser  wavelengths.  These  effects  are  incorporated  into  the  Air-to-Ground 
engagement  models  used  for  this  research,  discussed  in  the  following  sections. 
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These  effects  are  important  to  model,  since  understanding  the  way  laser  beams 
propagate  and  interact  with  atmospheric  molecules  may  give  insights  to  HEL 
weapon  system  performance  enhancements. 

2.13  Atmospheric  Models  -  LEEDR 

LEEDR  was  developed  by  the  Air  Force  Institute  of  Technology  Center  for 
Directed  Energy  (AFIT/CDE).  It  incorporates  first  principles  atmospheric 
propagation  and  uses  upper  air  data  to  characterize  percentages  of  molecular  and 
aerosol  absorption,  scattering,  and  turbulence.  Specifically,  LEEDR  calculates  and 
outputs  four  categories  of  data:  path  transmittance,  path  extinction  (km1),  surface 
visibility  (km),  and  slant  path  visibility  (km).  LEEDR  can  also  model  the  effect  of 
clouds,  fog,  and  rain.  This  model  was  specifically  developed  for  modeling 
atmospheric  effects  for  lasers  propagation,  which  is  why  each  atmospheric  profile  is 
a  function  of  a  specified  laser  wavelength.  LEEDR  creates  “profiles  of  temperature, 
pressure,  water  vapor  content,  optical  turbulence,  and  atmospheric  particulates  and 
hydrometeors  as  they  relate  to  line-by-line  layer  extinction  coefficient  magnitude  at 
wavelengths  from  the  UV  to  the  RF”  (Fiorino,  2008).  LEEDR  can  model  multiple 
sites  all  around  the  world,  and  for  several  different  seasons.  Figure  5  provides  a 
screen  shot  from  LEEDR  with  dots  indicating  the  available  geographic  locations  in 
the  model. 
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Figure  5:  LEEDR  Geographic  Locations 


LEEDR  calls  on  databases,  such  as  Extreme  and  Percentile  Environmental 
Reference  Tables  (ExPERT),  the  Master  Database  for  Optical  Turbulence  Research 
in  Support  of  the  Airborne  Laser,  and  the  Global  Aerosol  Data  Set  (GADS)  to 
acquire  probability  density  function  data  for  the  geographic  location  selected, 
enabling  the  upper  air  to  be  assessed  for  absorption,  scattering,  turbulence,  and  other 
parameters.  In  relation  to  how  they  are  calculated,  molecular  scattering  is  computed 
based  on  Rayleigh  theory,  molecular  absorption  effects  are  computed  for  the  top  13 
absorbing  species  using  line  strength  information  from  the  HITRAN  2004  database 
in  conjunction  with  a  community  standard  molecular  absorption  continuum  code, 
and  aerosol  scattering  and  absorption  are  computed  with  the  Wiscombe  Mie  model 
(Fiorino,  2008). 

Although  LEEDR  can  reference  databases  on  fde  to  acquire  information  on 
specific  geographic  locations,  it  also  provides  the  option  to  take  user  inputs  for  a 
geographic  location,  (i.e.  temperature,  dew  point,  pressure,  and  relative  humidity) 
and  calculate  upper  air  conditions  based  on  those  inputs.  Each  profile  is  dependent 
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on  the  laser  wavelength  defined  by  the  user.  The  option  to  input  data  is  extremely 
useful,  particularly  when  wanting  to  capture  atmospheric  variations  seen  in  one 
location  over  a  period  of  time,  or  season  rather  than  averaged  observations  provided 
by  ExPERT.  This  thesis  utilizes  the  user-input  option  to  simulate  varying 
atmospheric  conditions. 

2.14  HEL  Scaling  Model  -  HELEEOS 

Scaling  codes  are  considered  to  be  moderate  in  accuracy  in  comparison  to 
higher  fidelity  wave  optics  codes  that  are  based  on  microscopic  laws  of  electro¬ 
magnetic  (E-M)  radiation.  “[HEL]  Scaling  codes  start  from  phenomenology  of  and 
analytical  approximations  to  the  E-M  wave  equations,  and  attempt  to  represent  the 
details  of  propagation  through  the  atmosphere  with  a  few  parameters  based  on 
integrated  properties  of  the  atmospheric  conditions,  light  intensity,  wavelength,  etc.” 
(Rockower,  1985). 

HELEEOS  is  a  system-  level  scaling  code  that  models  various  HEL 
engagement  scenarios,  modeling  the  propagation  the  beam  from  the  laser  source  to 
its  target.  HELEEOS  was  developed  by  the  AFIT  Center  for  Directed  Energy  and  is 
anchored  to  high  fidelity  wave-optics  code,  called  WaveTrain.  It  models  everything 
from  atmospheric  effects  like  absorption,  scattering,  and  turbulence,  to  fog,  rain,  and 
clouds.  HEELEOS  can  model  many  types  of  engagement  scenarios,  such  as  Air-to- 
Ground,  Ground-to-Air,  and  horizontal  path  propagation.  HELEEOS  is  integrated 
with  LEEDR,  which  allows  it  to  access  a  climatologically  database  for  numerous 
geographic  locations  worldwide.  Forty  years  worth  of  weather  observations  for 
geographic  locations  are  included  in  the  ExPERT  database,  which  are  averaged  and 
available  for  scaling  codes  to  reference.  Absorption  and  scattering  transmission 
numbers  are  calculated  based  on  the  atmospheric  characteristics  of  the  geographic 
location  selected  within  HELEEOS.  HELEEOS  takes  absorption,  scattering,  and 
turbulence  effects  and  calculates  a  vertical  profile  by  which  laser  transmittance  can 
be  estimated. 

User  inputs  include  engagement  scenario  geometry,  laser,  optics,  and 
platform  characteristics,  atmospheric  conditions,  and  target  information.  HELEEOS 
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calculates  a  variety  of  outputs  about  the  engagement,  ranging  from  a  detailed  list  of 
atmospheric  effects,  peak  and  average  intensity  on  target,  power  in  bucket,  etc.  It  is 
a  very  effective  tool  for  running  large  performance  trade  studies  to  identify  key 
performance  parameters.  Many  analysts  use  HELEEOS  as  the  first  stage  of 
analyzing  a  large  trade  space  of  designs,  then  once  they  scope  it  to  something  more 
manageable,  they  use  wave  optics  to  gain  higher  fidelity  on  the  designs  of  most 
interest. 

2.15  Target  Lethality  Modeling 

HEL  performance  measures  typically  relate  target  lethality,  or  damage  criteria. 
“Damage”  is  subject  to  interpretation,  but  may  can  be  defined  as  achieving  a  target 
capsize,  explosion,  or  simply  damaging  the  target  enough  to  render  it  non¬ 
functional.  Since  materials  melt  at  different  rates  and  require  different  intensities, 
most  target  types  will  have  their  own  target  lethality  requirements.  “The  desired 
effect  on  the  target  ultimately  decides  what  is  needed  from  the  laser”  (Anderberg 
and  Wolbarsht,  1992).  Since  the  objective  is  to  damage  a  target,  the  HEL  beam  is 
focused  on  the  region  of  weakest  strength  on  the  target.  Even  different  aim-points  on 
one  target  will  have  different  lethality  criteria,  based  on  differences  in  material 
strength. 

Three  common  performance  measures  used  to  HEL  intensity  on  target  are 
irradiance,  bucket  size,  and  fluence. 

Irradiance,  /,  refers  to  the  HEL  power,  P,  delivered  on  a  target,  divided  by 
the  area  of  the  beam,  A.  Its  units  are  in  watts/cm  ,  or  power  per  unit  area: 


P 


1  -  - 
A 


(3) 


Irradiance  in  combination  with  lase  time  on  target  is  called  fluence.  Fluence,  F,  is 
irradiance  accumulated  on  target  over  a  specific  time  frame,  or  dwell  time,  td-  Its 
units  are  in  kilo  jewel  /cm2,  or  energy  per  unit  area: 


(4) 
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Fluence  is  the  most  accurate  measure  to  determine  if  a  HEL  weapon  will 
achieve  a  certain  level  of  damage  to  target.  Fluence  requirements  by  aim-point 
reflect  a  target’s  vulnerabilities  and  susceptibility  to  HEL  attack.  For  this  reason, 
fluence  levels  are  kept  classified,  and  unclassified  measures,  like  irradiance  and 
power  in  bucket  are  used  for  conducting  unclassified  analysis. 

Power  in  Bucket,  PIB,  is  the  total  power  (in  Watts)  delivered  to  a  specifically 
defined  spatial  region,  typically  circular  or  square,  on  the  target.  It  is  used  as  a 
measure  of  the  total  power  delivered  in  the  defined  area.  However,  any  information 
on  the  specific  spatial  distribution  (very  peaky,  or  very  broad,  or  very 
broken/distorted)  of  power  delivered  is  lost  with  this  metric. 

For  convenience,  analyst  use  irradiance  as  the  measure  to  compare  HEL 
concepts,  as  it  provides  a  basis  to  compare  two  concepts  for  achieved  power  per 
unit,  yet  does  not  reveal  sensitive  information  about  its  target’s  vulnerabilities.  This 
thesis  uses  power  in  bucket  as  its  performance  measure. 

2.16  JMP  Statistical  Tool 

JMP  is  a  statistical  tool  developed  by  SAS  in  1989.  JMP  is  extremely  useful 
for  developing  custom  experimental  designs,  and  performing  regression  analysis  to 
fit  an  empirical  model.  The  tool  has  a  multiple  number  of  transformations  and 
techniques  use  to  best  fit  and  evaluate  an  empirical  model.  JMP  is  the  tool  used  to 
conduct  statistical  analysis  in  this  research. 

2.2  Design  of  Experiment 

DOE  is  a  methodology  used  to  plan,  conduct,  and  analyze  an  experiment.  “It 
is  the  process  of  planning  the  experiment  so  that  appropriate  data  will  be  collected 
and  analyzed  by  statistical  methods,  resulting  in  valid  and  objective  conclusions” 
(Montgomery,  2009). 
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2.21  Terminology 

There  are  many  terms  used  throughout  this  thesis  in  which  the  reader  should 
be  somewhat  familiar.  A  response  variable  is  selected  by  the  experimenter,  and  is 
the  output  from  a  system,  or  the  result  collected  from  an  experiment.  There  can  be 
many  responses  of  interest  collected  during  in  an  experiment,  but  they  must  be 
observable  and  measurable.  A  factor  is  a  parameter  or  “input”  that  needs  to  be  set 
for  an  experiment.  Factors  can  be  classified  as  controlled  or  uncontrolled.  As  the 
term  suggests,  controlled  factors  are  those  in  which  experimenter  has  full  ability  to 
control.  An  example  of  this  may  be  the  ratio  of  chemicals  used  in  an  experiment. 
Controlled  parameters  can  either  be  held-constant  throughout  the  entire  experiment, 
or  selected  to  be  design  factors  which  are  intentionally  varied  from  test  to  test  in 
order  to  observe  the  impact  they  have  on  the  response.  If  a  design  factor  is  varied,  its 
different  settings  are  called  levels.  Uncontrolled  factors  cause  variation  in  the 
response  not  explained  by  the  design  factors,  and  are  generally  unavoidable,  yet 
present  in  any  test.  They  are  also  known  as  nuisance  factors,  noise,  or  error. 
Examples  of  this  may  be  influences  of  weather,  use  of  non-homogenous  test 
materials,  poor  instrument  calibration,  operator  error,  etc.  Some  nuisance  factors 
have  little  to  no  impact  on  the  response,  however  some  can  have  a  significant 
impact,  transmitting  variations  to  test  results  which  dilute  the  traceability  of  the 
cause  and  effect  relationship  between  the  design  factors  of  interest.  The  ratio  of 
impact  caused  by  design  factors  and  those  caused  by  nuisance  factors  is  often 
referred  to  as  the  signal-to-noise  ratio.  A  treatment  combination  or  design  point  is  a 
unique  combination  of  factors  and  their  levels  to  be  tested.  An  experimental  design 
is  the  actual  schedule  indicating  which  order  the  design  points  will  be  run. 

2.22  Seven  Stages  of  Design  of  Experiment 

Douglas  Montgomery,  author  of  a  leading  DOE  text,  suggests  using  seven 
stages  of  DOE  methodology.  These  seven  stages  of  DOE  are  important  to  creating 
an  effective  and  efficient  test  from  which  objective  conclusions  can  be  drawn. 

1)  State  the  Problem  and  Objective.  This  stage  defines  the  problem  or  need  to 
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have  the  test  in  the  first  place.  It  usually  involves  speaking  with  customers  to 
understand  expectations  and  clarify  test  objectives. 

2)  Select  appropriate  response  variables.  A  test  may  have  multiple  response 
variables.  It  is  key  they  are  measurable,  and  reflect  important  or  valuable 
information  about  the  design  factors  being  tested. 

3)  Select  design  factors,  and  number  of  levels  and  ranges  to  be  varied.  Design 
factors  are  typically  chosen  based  on  the  belief  they  will  effect  system  performance. 
The  number  of  levels  a  design  factor  varies  is  based  on  sensitivities,  or  the  rule  of 
thumb  that  levels  be  far  enough  apart  that  a  standard  deviation  of  three  is  seen  in  the 
response  distribution.  The  range  of  a  design  factor  is  based  on  the  size  of  design 
space  one  wishes  to  analyze. 

4)  Select  an  Experimental  Design  -  There  are  two  key  principles  Montgomery 
stresses  when  creating  an  effective  and  efficient  experimental  design,  and  they  are 
replications  and  randomization. 

Replications  are  independent  repeats  of  a  factor  combination.  The 
advantages  of  replications  are  that  they  provide  more  than  one  sample  point  of  a 
treatment  combination,  which  will  yield  a  better  estimate  of  pure  error,  as  well  a 
better  estimate  of  the  true  population  mean  and  variance.  Replications  also  provide  a 
basis  to  objectively  compare  two  sets  of  data  to  see  if  they  are  statistically  different. 

Randomization  is  the  principle  by  which  we  can  assume  error  is  independent 
and  identically  distributed  across  the  experiment.  Randomization  is  both  a  technique 
and  statistical  assumption  in  DOE.  The  technique  of  randomization  typically  applies 
to  intentionally  randomizing  the  order  in  which  a  test  of  treatment  levels  will  be  run. 
This  technique  comes  from  the  statistical  assumption  that  error,  if  present,  is  a 
random  variable  which  is  identical  and  normally  distributed.  This  means  if  error  is 
present,  it  is  best  spread  randomly  across  all  tests  as  opposed  to  systematically 
spread,  which  can  bias  results.  This  assumption  is  significant  because  it  allows  us  to 
draw  unbiased,  statistical  inferences  about  our  data. 

There  are  many  types  of  experimental  design,  such  as  factorial,  fractional 
factorial,  Latin  least  square,  etc.  No  one  design  can  best  accommodate  every  type  of 
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test  scenario,  which  is  why  there  are  multiple  types  of  designs.  The  design  used  in 
this  research  is  a  factorial  design,  which  varies  each  design  factor  in  conjunction 
with  other  factors  to  enable  an  assessment  of  interactions,  if  they  exist. 

5.  Conduct  the  test. 

6.  Statistical  Analysis  of  the  Response.  The  objective  of  statistical  analysis 
is  to  analyze  the  response  variables  and  try  to  explain  variations  produced  by  the 
regressor  variables  (design  factors)  of  interest.  The  analysis  process  begins  by 
developing  an  empirical  model  built  from  the  response  data.  Figure  6  shows  the 
relationship  between  the  real  system,  the  observations  produced  from  the  system, 
and  the  empirical  built  from  the  observations  which  allows  us  to  draw  inferences 
back  to  the  real  system.  This  diagram  is  presented  by  AFIT’s  Dr  Raymond  Hill  in 
OPER  688,  Design  of  Experiments.  This  process  assumes  Montgomery’s  seven 
stages  of  DOE  are  followed. 


I  inferences  based  from  statistics 


Figure  6:  Relationship  of  Real  Systems  to  their  Empirical  Models 

Output  data  from  a  system  is  considered  a  sample  of  the  population  of  all 
possible  outputs  from  that  system.  The  more  samples  obtained,  the  better  the 
estimate  of  the  true  population  mean  and  variance,  which  describe  the  first  two 
moments  of  any  distribution.  An  empirical  model  is  a  functional  representation  a 
system,  and  is  built  on  observations  either  produced  by  the  system  during  a  test,  or 
from  a  simulation  of  the  system.  A  well  fit  empirical  model  can  provide  a  predictive 
capability  for  how  the  system  performs,  through  the  design  space  considered. 
Although  empirical  models  may  not  achieve  a  perfect  fit,  particularly  to  non-linear 
data,  they  can  provide  a  good  approximation  of  system  performance.  An  empirical 
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model  is  composed  of  four  parts:  a  response  variable,  y,  a  y-intercept  term,  J3a,  any 
regressor  variables  modeled,  / 3k  ,  (where  k  is  the  number  of  design  factors),  and  an 
error  term,  s. 

y  =  /30  +  fik  +  £  (5) 

The  error  term  is  any  variation  that  cannot  be  explained  by  the  regressor 
variables.  As  long  as  statistical  principles  are  incorporated,  statistical  inferences  can 
be  drawn  about  the  data,  such  as  dependencies  and  parameter  relationships 
(including  those  non-linear).  Also,  with  replications  included  in  the  experimental 
design,  sets  of  data  points  for  one  design  factor  provide  a  better  estimate  of  pure 
error  that  exists  in  the  test. 

For  this  research,  a  meta-model  technique  is  used,  where  an  empirical  model 
is  built  upon  outputs  of  a  model  itself.  Meta-models  are  used  when  live  tests  cannot 
be  conducted  or  response  data  from  previous  tests  are  unobtainable. 

5)  Conclusions  and  Recommendations  Empirical  models  and  regression 
analysis  can  help  reveal  a  great  deal  about  cause  and  effect  relationships  between 
regressors  and  an  associated  response,  however,  the  rule  of  causality  states 
conclusions  implying  cause  and  effect  cannot  be  made  based  on  data  alone,  but  in 
conjunction  with  other  information  about  the  system.  The  empirical  model  can 
suggest  design  factor  levels  and  ranges  which  are  found  to  be  achieve  the  best 
performance,  given  the  design  space  considered  or  modeled.  This  ensures 
conclusions  are  not  being  made  just  on  data  alone,  which  could  be  a  result  of 
coincidence,  but  rather  supported  in  combination  with  knowledge  known  about  how 
the  system  works,  and  weather  statistical  results  make  practical  sense. 

2.3  Response  Surface  Methodology 

RSM  is  a  technique  used  to  analyze  data  that  cannot  simply  be  characterized  by 
a  first  order  empirical  model.  Typically  RSM  is  used  to  estimate  system 
performance  over  some  region  of  interest  and  use  that  empirical  model  to  either  find 
factor  settings  that  achieve  improved  performance  or  to  locate  new  areas  where 
improved  performance  might  be  attained.  For  this  research  RSM  is  used  to  visualize 
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the  nonlinear  relationship  between  our  factors  interest  and  the  model  response.  We 
also  use  the  optimization  component  of  RSM  to  suggest  our  area  of  best 
performance  in  our  defined  design  region. 

2.4  Case  Studies  -  Analysis  &  Results 

Numerous  sensitivity  studies  have  been  conducted  using  HEL  engagement 
models,  specifically  HELEEOS.  Three  of  these  studies  are  discussed  below: 

1) .  “Capability  Assessment  of  the  High-Energy  Laser  Liquid  Area  Defense  System 
(HELLADS)”,  by  Ryan  Ponack.  Ponack  uses  HELEEOS  with  the  Extended  Air 
Defense  Simulation  Model  (EADSIM)  mission  level  model,  to  estimate  the 
performance  a  conceptual  weapon  system  in  an  Air-to-Ground  engagement  in  a 
homeland  defense  arena.  Ponack  found  that  the  most  influential  parameters  analyzed 
to  be  platform  altitude,  target  altitude,  platform  velocity,  and  line  of  sight  (Ponack, 
2009). 

2) .  “Characterizing  effects  and  Benefits  of  Beam  Defocus  on  High  Energy  Laser 
Performance  Under  Thermal  Blooming  and  Turbulence  Conditions  for  Air-to- 
Ground  Engagements”,  by  Scott  Long,  examines  the  advantages  of  defocusing  a 
beam  with  nuisance  factors  present.  Long  models  the  Air-to-Ground  engagement  in 
HELEEOS  and  verifies  results  with  wave  optics  simulations  (Long,  2008).  Results 
show  reasonable  improvement  of  intensity  on  target  with  defocusing  the  beam.  Long 
examines  other  sensitivities  by  varying  one  factor  at  a  time. 

3) .  “Assessment  of  Optical  Turbulence  Profiles  Derived  from  Probabilistic 
Climatology”,  by  Brett  Wisdom.  Wisdom  implements  DOE,  using  a  factorial  design 
to  statistically  compare  values  between  turbulence  within  HELEEOS  to  actual 
thermosonde  data.  He  found  that  the  two  data  sets  are  statistically  equivalent,  within 
a  confidence  interval  of  80%  (Wisdom,  2007).  This  helped  verify  that  based  on 
specific  atmospheric  layers  analyzed,  HELEEOS  accurately  simulates  true 
turbulence  effects. 

Each  of  the  above  studies  helps  verify  the  accuracy  of  calculations  within 
HELEEOS,  and  helps  ensure  its  algorithms  for  calculating  nuisance  factors  are 
accurate,  or  that  it  is  well  anchored  to  the  high  fidelity  wave-optics  simulations  to 
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which  it  is  compared.  The  first  two  case  studies  vary  one  factor  at  a  time  to  capture 
performance  sensitivities.  This  approach  is  beneficial  when  just  estimates  of  main 
effects  are  of  interest.  However,  to  capture  the  interaction  or  non-linear  effects 
within  a  model,  two  of  more  factors  must  be  varied  in  combination.  The  third  case 
study  does  this.  All  three  case  studies  model  nuisance  factors  using  data  within 
HELEEOS,  which  results  in  deterministic  modeling  of  nuisance  factors  as  a  function 
of  time  of  day  and  geographic  location  selected. 

This  thesis  focuses  on  capturing  two  important  aspects  of  modeling  a  realistic  Air- 
to-Ground  HEL  engagement.  First,  an  experimental  design  is  use,  which  varies  all 
factors  systematically,  allowing  interactions  and  non-linear  effects  to  be  analyzed. 
Second,  nuisance  factors  are  modeled  stochastically,  and  then  incorporated  into 
HELEEOS,  capturing  the  realistic  nature  of  a  dynamic  atmosphere.  These  two 
approaches  allow  us  to  draw  inferences  about  significant  effects  that  drive  HEL 
performance,  with  respect  to  performance  degradation  due  to  nuisance  factors 
present. 
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III.  Research  Methodology 


3.1  Chapter  Overview 

This  research  uses  DOE  and  RSM.  DOE  involves  the  pre-planning  for 
determining  what  will  be  the  test  objective,  what  will  vary  from  test  to  test,  and  how 
the  objective  will  be  measured.  The  engagement  modeled  is  a  HEL  weapon 
deployed  on  a  Bl,  attempting  to  immobilize  a  truck  from  an  altitude  of  30,000  ft.  A 
set  of  108  design  points  are  tested  (each  is  a  simulation  configuration),  covering  the 
design  space  for  the  Air-to-Ground  HEL  engagement  scenario.  These  108  design 
points  are  run  through  LEEDR,  the  atmospheric  model,  and  HELEEOS,  the  laser 
propagation  model.  RSM  is  used  to  conduct  statistical  analysis  on  the  response 
outputs  from  HELEEOS  by  using  the  statistical  tool,  JMP.  This  chapter  discusses 
the  modeling  approach  used,  model  limitations,  inputs  and  work-arounds,  as  well  as 
assumptions  made  regarding  modeling  simplifications.  This  section  also  discusses 
the  how  to  find  design  settings  to  achieve  best  laser  weapon  performance  for  the 
design  space  considered. 

3.2  Context  of  the  problem 

A  challenge  in  laser  weapon  systems  is  maintaining  the  intensity  of  the  laser 
beam  from  the  laser  source  to  its  intended  target.  Interferences  such  as  line-of-sight 
obstacles  or  the  atmosphere  dilute  the  beam’s  intensity.  A  myriad  of  effects 
influence  laser  weapon  irradiance.  A  fishbone  diagram  in  Figure  7  captures  many 
(but  not  all)  effects  that  exist  in  Air-to-Ground  laser  engagements.  Fishbone 
diagrams  are  effective  for  understanding,  scoping,  and  deciding  how  to  model  the 
problem  scenario.  Some  of  the  results  we  measure  in  laser  testing  are  irradiance, 
fluence,  power  in  bucket,  or  other  parameters  which  can  relate  information  about 
target  damage. 
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Figure  7:  Fishbone  Diagram  Showing  Factor  Influences 

The  objective  of  our  engagement  model  is  to  first,  accurately  model  the  Air- 
to-Ground  engagement,  and  second,  to  capture  the  main  effects  or  factors  that  are 
driving  system  performance.  Deciding  which  main  effects  to  intentionally  vary  for 
tests,  or  design  factors,  is  a  part  of  DOE  methodology.  The  design  factors  are  all 
controlled  factors.  Since  nuisance  factors  exist  in  real  testing,  it  is  important  to 
incorporate  their  effects  into  the  modeling  process,  in  order  to  collect  data 
representative  of  the  actual  system  modeled.  Figure  8  updates  the  fishbone  analysis 
and  characterizes  the  effects  in  the  problem  scenario  as  either  uncontrolled  or 
controlled.  This  characterization  influences  the  design  of  the  research  experiment. 
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Figure  8:  Fishbone  Diagram  Characterizing  Factors 


3.3  Modeling  Assumptions 

Several  assumptions  were  made  to  reduce  the  complexity  of  the  scenario 
being  modeled.  These  assumptions  pertain  to  technology  maturity,  system  level 
modeling  only,  reduction  in  nuisance  factor  considerations,  and  assuming  a 
conformal  window  to  eliminate  air  vehicle  aero-optical  effects. 

Technology  Readiness  Level  (TRL):  It  is  assumed  that  any  laser  weapon 
conceived  (i.e.  400kW  class  electric  laser  with  excellent  beam  quality),  is 
technologically  mature  enough  to  complete  the  Air-to-Ground  engagement  being 
modeled.  The  scenario  engagement  is  defined  with  a  2022  timeframe  in  mind. 

System  Level  Modeling:  Laser  weapon  sub-systems  are  not  modeled.  What 
is  modeled  is  the  system  level,  which  is  a  fully  functional  laser  weapon  system 
integrated  within  a  Bl-B  platform.  HEL  weapons  are  composed  of  four  different 
sub-systems:  thermal  management,  beam  control,  the  laser  itself,  and  system  control. 
There  are  many  designs  and  ways  to  configure  these  4  sub-systems,  each  of  which 
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can  drastically  alter  system  performance.  This  research  models  sub-system 
capabilities  at  the  system  level  effect  only. 

Nuisance  Factor  Considerations :  There  are  a  plethora  of  nuisance  factors  in 
a  real  Air-to-Ground  test  scenario  but  not  modeled  in  this  thesis.  They  pertain 
mostly  to  human-in-the-loop  and  system  nuisance  factors.  Human-in-the-loop 
nuisance  factors  are  caused  by  all  humans  that  play  a  part  in  a  test  and  may 
accidently  cause  slight  variations  from  test  to  test,  introducing  inconsistencies  in 
results.  These  inconsistencies  could  be  caused  by  having  more  than  one  flight 
operator,  each  with  different  levels  of  experience  or  tendencies.  Inconsistencies 
could  be  introduced  by  test  crews  with  instrument  calibration  inconsistencies,  or 
using  different  materials  from  test  to  test.  An  example  system-level  nuisance  factor 
is  residual  heat  left  over  from  lazing  on  a  test  impacting  a  subsequent  test.  This 
introduces  dependencies  among  tests  and  can  bias  the  results  of  the  test.  The  only 
system-level  nuisance  factor  modeled  is  residual  platform  jitter,  which  are  the 
vibrations  within  the  platform  of  the  Bl-B  in  x,  y,  and  z  directions,  caused  by 
moving  through  a  turbulence  in  the  atmosphere.  These  platform  vibrations  create 
issues  for  the  mirror  alignment  in  the  beam  control  system,  and  cause  unwanted 
dithering  to  the  laser  beam  when  trying  to  focus  intensity  on  a  target. 

Aero-Optical  Elimination :  Most  current  HEL  programs  still  use  turrets,  a 
sensor  that  communicates  with  the  acquisition  and  tracking  and  system  control  to 
acquire  the  location  of  a  target.  A  low  power  laser,  or  track  illuminator  illuminates 
the  target  or  aim-point,  and  then  passes  the  high  power  through  the  turret,  sending 
the  beam  propagating  through  the  atmosphere  to  its  target.  The  issues  with  turrets 
are  that  when  deployed,  they  are  not  flush  with  the  bottom  of  the  aircraft,  and 
because  they  protrude,  they  create  aero-optical  effects  which  forces  air  to  channel 
around  the  turret.  These  effects  can  be  highly  detrimental  to  laser  weapon 
performance,  particularly  when  shooting  to  targets  in  the  rear  of  the  aircraft  direction 
in  flight.  Conformal  windows  are  a  concept  introduced  which  fit  flush  with  the 
aircraft  belly,  thus  reducing  aero-optical  effects.  This  type  of  window  reduces  the 
field  of  view  or  field  of  regard,  as  it  is  mostly  limited  to  shooting  straight  down 
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when  at  low  altitudes.  For  this  research,  a  conformal  window  is  assumed,  and  aero- 
optical  effects  are  not  modeled. 

3.4  Modeling  Process  and  Inputs 

For  this  research,  the  Air-to-Ground  HEL  engagement  scenario  is  modeled  using 
one  database,  two  models,  and  one  statistical  tool.  Figure  9  shows  the  process  used 
to  model  the  engagement,  produce  the  response  data,  and  conduct  statistical 
analysis.  This  process  starts  by  developing  a  database  containing  Meteorological 
Aviation  Reports  (METARS)  from  the  14th  Weather  Squadron.  METARS  provide 
recordings  of  visibility,  atmospheric  extinction,  and  other  atmospheric  effects  at  the 
earth’s  surface  for  a  specified  geographic  location.  METAR  observations  are  stored 
in  this  database  and  picked  randomly  as  input  to  LEEDR.  This  induces  atmospheric 
variation  into  the  HEL  engagement,  making  each  model  stochastic.  LEEDR  3.1 
takes  the  METAR  observation  and  simulates  weather  conditions  in  the  troposphere 
and  stratosphere.  LEEDR  outputs  absorption,  scattering,  and  other  atmospheric 
conditions  as  a  function  of  altitude.  These  atmospheric  profiles  are  then  imported 
into  HELEEOS  3.0,  which  propagates  the  laser  through  the  specified  atmosphere 
and  outputs  irradiance  on  the  target.  JMP  is  used  to  conduct  statistical  analysis  on 
the  response  data  and  allows  us  to  determine  which  factors  in  the  model  contribute 
most  to  HEL  performance. 
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MODELING  &  ANALYSIS  PROCESS 
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Figure  9:  Modeling  and  Analysis  Process 


The  following  sections,  3.41-3.42,  provide  constant  (or  baseline)  inputs  used 
for  HELEEOS  and  LEEDR  to  simulate  the  HEL  engagement.  Model  outputs 
parameters  are  also  listed  for  each  model.  Section  3.5  discusses  modifications  made 
to  simulate  atmospheric  variations,  including  data  extracted  from  the  14th  Weather 
Squadron. 

3.41  LEEDR  Inputs 

Figure  10  displays  all  inputs  required  to  run  LEEDR.  The  “varied”  inputs  are 
considered  design  factors  or  nuisance  factors.  The  constant  inputs  are  assumed 
controlled,  and  are  baseline  settings.  Nuisance  variable  inputs  are  discussed  in 
section  3.5.  Design  variables  are  discussed  in  section  3.62. 
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Varied 

Wind  Direction  (0 -North) 
Wind  Ground  Speed  (m/s) 
DewPoint  (F) 

Surface  Temperature  (F) 
Surface  Visibility  (m  s) 
Turbulence  Multiplier 
Laser  Wavelength  (grads) 
Slant  Range  to  Target  (m) 


Held  Constant 

Location  (Lat, Long):  ( 39.83,  -84.05) 

Boundary  Layer  Defined:  1524 

Season:  Summer 

Time  of  Day:  12:00-1 5:00 

Aerosol  Type:  G.iDS  Worldwide 

Mo  1  ecul  ar  Ty  p  e:  Calcu  la  ted 

Wind  Type:  Bufton 

Clouds:  Disabled 

Turbul  en  c  e  Ty  p  e :  HV  5/7 

High e st Altitude  (meters ) :llf000 


LEEDR 


QITPLTS 

r  (Given  for  every  100  m  change  in  Altitude) 
Temperature  (F) 

Dewpoint  (F) 

Pressure  (mb) 

Relative  Humidity  (%) 

Aero  so  1  Ab  sor  pti  on  ( 1  /km) 

Aerosol  Scattering  (1/km) 

Molecular  Absorption  (1  km) 

Molecular  Scattering  (1 /km) 

Wind  Speed  (m  s) 

Wind  Direction  -Constant 
Total  Absorption  ( 1  km) 

Total  Scattering  ( 1  /km) 

Insoluble  Aerosol  Concentration  (cmA-3) 

Soot  Aerosol  Concentration  (cmA-3 ) 
Water-soluble  Aerosol  Concentration  (cmA-3) 


Figure  10:  LEEDR  Constant  Inputs 

LEEDR  outputs  data  into  an  Excel  file  which  is  easily  imported  into 
HELEEOS.  Every  design  point  entered  into  LEEDR  has  a  distinct  atmospheric 
profile.  The  random  variations  induced  by  the  METAR  observations  have  turned 
LEEDR  into  a  stochastic  model  which  produces  a  random  variable  as  an  output. 

3.42  HELEEOS  Inputs 

Aside  from  variations  introduced  by  LEEDR’ s  atmospheric  profile,  HELEEOS 
also  models  random  variations  in  platform  jitter,  discussed  in  section  3.53. 
HELEEOS  is  the  last  model  used,  which  produces  the  response  data  to  be  analyzed. 
All  held-constant  inputs  are  listed  in  Figure  1 1.  As  mentioned  in  the  baseline 
development  section,  many  of  these  inputs  have  been  provided  by  subject  matter 
experts  or  borrowed  from  current  Directed  Energy  programs. 
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INPUTS 

Au- to- Ground  Engagement 

Vailed 

HEL  Power  (Watts) 

Beam  Quality 
Aperture  Diameter  (m) 

Laser  Wavelength  (pi  ad) 

Path  Length  (in) 

Platform  Jitter  (jiirad) 

Mirror  Actuator  Spacing  (m) 

Held  Constant 

Platform  Altitude  (m):  10,000 
Platform  Horizontal  Velocity  (m/s):  243 
Platform  Heading  (degrees):  0 
Target:  Stationary  Truck 
Engagement  Stq)  Size:  1 
Error  Rejection  Bandwidth  (Hz): 

-Adaptive Optics:  500, Track ei  1000 
AO  Beacon  Diameter  (in):  0.5 
AO  Latency  of  Transmit  Loop  0.00049 
Tracker  Latency  ofiY answitLoop:  0.00287 
Obscuration  &  Wave-front  Error:  0 
Laser  Type:  Top  Hat  &  Continuous' 

Aero-Optics:  None 

Extinction  &  Turbulence:  Imported  from  LEETR 


HELEEOS  Model 


'—(ITi 


outputs 


Effects  oil  Target: 

Power  In  Bucket  (Watts) 

Peak  Inadiance  (W/cin2) 
Average  Inadiance  (W/cm2) 
Detrimental  Effects: 

Thennal  Blooming  Distortion  - 


Figure  1 1 :  HELEEOS  Constant  Inputs 


3.5  Model  Modifications  to  Simulate  Variability  of  Atmospheric  Effects 

The  process  of  modeling  a  stochastic  atmosphere  for  a  laser  to  target 
engagement  was  a  several  step  process,  due  to  current  limitations  of  the  existing 
models.  Laser  propagation  codes  currently  used  by  the  DoD  are  not  stochastic,  but 
rather  deterministic.  Although  the  scaling  code  algorithms  are  based  on 
probabilities,  the  outputs  themselves  are  not  probabilistic  because  they  are  based  on 
atmospheric  data  over  40  years  which  has  been  averaged  together,  thus  diluting  the 
effects  of  any  extreme  conditions  seen  in  the  tails  of  the  atmospheric  probability 
distribution.  To  obtain  any  insights  as  to  how  design  parameters  are  influenced  by 
nuisance  factors,  the  nuisance  factors  must  be  modeled  randomly  as  they  would  be 
found  in  real  life.  Modeling  variability  in  the  laser  engagement  came  in  two  forms, 
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variability  associated  with  the  atmosphere,  and  variability  associated  with  aircraft  or 
“platform”  jitter  .  The  following  discussion  explains  the  extent  of  each  modification. 

3.51  Absorption  &  Scattering  Data  from  14th  Weather  Squadron 
The  14th  Weather  Squadron  releases  hourly  METARs  which  provide  the 
status  of  wind  (speed  &  direction),  temperature,  dew  point,  visibility  at  the  earth’s 
surface,  and  many  other  conditions  for  a  specified  location.  METARs  are  used 
primarily  for  aviators  wanting  to  know  atmospheric  conditions  both  at  the  earth’s 
surface  and  the  sky.  For  this  thesis,  the  METARs  provide  data  that  reflects  actual 
variations  found  in  the  atmosphere  for  a  mid-latitude  climate.  The  data  types  of 
interest  for  this  study  are  dew  point,  pressure,  temperature,  surface  visibility,  wind 
speed,  and  wind  direction.  These  six  METAR  outputs  are  used  as  inputs  into 
LEEDR.  LEEDR  takes  the  weather  conditions  from  the  earth-surface,  and  calculates 
absorption,  scattering,  and  visibility  as  a  function  of  altitude.  The  METARs 
collected  came  from  the  station  KFFO,  (Dayton,  Ohio).  Since  the  summer  season 
was  of  interest,  METAR  data  was  collected  for  June,  July,  and  August  for  the  last  5 
years  (2007-present),  at  12pm.  This  interval  provided  roughly  450  days  of  Dayton 
summer  at  noon,  which  captures  both  extreme  and  average-day  weather.  Random, 
independent,  and  identically  distributed  samples  without  replacement  were  pulled 
from  this  distribution,  providing  a  unique  atmosphere  (or  absorption  and  scattering 
effect)  for  each  simulation  run.  Refer  to  Appendix  B  for  the  experimental  design 
with  actual  atmospheric  data  married  to  each  design  point.  These  are  the  “varied” 
inputs  entered  into  LEEDR. 

3.52  Turbulence  Random  Multiplier 

HELEEOS  3.0  models  turbulence  using  averaged  data  which  produces 
deterministic  results.  Realistically,  turbulence  is  a  variable  in  the  atmosphere,  and 
should  be  modeled  stochastically  to  better  represent  a  dynamic  atmosphere. 
Turbulence  exists  in  any  laser  propagation  test,  and  varies  from  test  to  test. 

However,  turbulence  is  not  an  output  of  METAR  reports.  One  way  to  simulate 
turbulence  is  to  use  a  standard  vertical  profile  of  turbulence  values  from  HELEEOS, 
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i.e.  Huff-Nagel  Valley  5/7,  and  vary  its  strength  based  on  a  turbulence  multiplier.  To 
determine  a  reasonable  multiplier,  a  climatological  turbulence  profile  for  a  mid¬ 
latitude  location,  (i.e..  Dayton,  OH),  was  used  to  create  a  representative  distribution. 
The  suggested  distribution  is  a  lognormal  distribution,  with  mean  0.22,  and  variance, 
0.7  (Fiorino,  201 1).  We  pulled  324  samples  from  this  distribution,  assigning  each 
design  point  an  independent  and  identically  distributed  random  turbulence 
multiplier.  For  each  replication,  the  turbulence  multiplier  is  unique.  Refer  to 
Appendix  C,  Turbulence  Multiplier  and  Jitter  Inputs  for  the  actual  multipliers 
entered  into  HELEEOS. 

Histogram 


140  n 
120  - 
lOO  - 


Turbulence  Multiplier 


Figure  12:  Turbulence  Multiplier  Distribution 

3.53  Platform  Jitter  Input  as  a  Random  Variable 
Platform  jitter  is  another  nuisance  factor  which  impacts  laser  beam 
scattering.  There  are  measures  to  control  some  of  the  platform  jitter  through 
vibration  tables,  however,  these  methods  cannot  eliminate  the  effects  of  jitter 
completely.  Small  amounts  of  jitter  are  inevitable,  and  are  thus  considered  an 
uncontrolled  nuisance  factor.  In  general,  the  smaller  the  platform  jitter,  the  less 
likely  we  tend  to  dither  the  beam  on  the  target  at  the  ground.  HELEEOS  3.0  did  not 
have  a  multiplier  to  vary  this  input,  thus  the  input  was  varied  in  Excel,  then  input 
into  HELEEOS.  The  distribution  use  to  create  variable  jitter  effects  was  assumed  to 
be  a  normal  distribution,  with  mean  1  and  variance  0.2.  A  total  of  324  samples  were 
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used  to  create  the  distribution,  assigning  each  experiment  an  independent  and 
identically  distributed  random  sample.  Although  the  distribution  type  is  speculative, 
subject  matter  experts  did  give  a  mean  and  variance  projections  for  jitter  in  the  year 
2022  (Bartell,  2011).  This  parameter  induces  variation  into  the  HEL  engagement 
model,  and  is  the  only  system-related  nuisance  factor  modeled.  Each  design  point 
tested,  and  each  replication  of  that  design  point,  has  a  unique  jitter  effect. 


Platform  Jitter  Distribution  (jirads) 


Figure  13:  Platform  Jitter  Distribution 

The  values  used  for  platform  jitter  can  be  seen  in  Appendix  C:  Turbulence 
Multiplier  and  Jitter  Inputs  for  the  actual  multipliers  entered  into  HELEEOS 

3.6  DOE  -  Methodology  and  Experimental  Design 

This  section  discusses  the  experimental  design  approach.  The  engagement 
models  an  HEL  weapon  integrated  into  a  Bl-B,  whose  objective  is  to  immobilize  a 
truck  from  30,000  ft  in  the  air. 

3.61  Defining  the  Baseline  Mission  Scenario  and  Response 

The  mission  scenario  modeled  for  this  research  is  an  Air-to-Ground 
engagement  between  an  airborne  HEL  weapon  system  and  a  stationary  target  on  the 
ground,  a  truck.  The  specifics  of  this  mission  scenario  come  from  a  current  program 
in  the  US  DoD’s  Directed  Energy  Directorate,  called  the  Electric  Laser  on  a  Large 
Aircraft  (ELLA).  This  program  is  currently  integrating  a  150  kW  laser  into  the 
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bomb-bay  of  Lockheed’s  Bl-B  aircraft.  There  are  a  variety  of  Air-to-Air  and  Air-to- 
Ground  mission  vignettes  involved  in  ELLA’s  test  demonstration,  both  offensive 
and  defensive  missions,  with  targets  ranging  from  stationary,  dynamic,  and  even 
airborne.  For  this  research,  only  the  Air-to-Ground  mission  is  modeled  with  a 
stationary  truck  as  its  target.  The  mission  scenario,  mid-latitude  atmosphere  type, 
aircraft  type,  flight  altitude,  engagement  slant  ranges,  aircraft  heading,  and  aircraft 
speed  parameters  were  all  provided  by  the  ELLA  analysis  team,  and  used  to 
establish  the  baseline  results.  The  actual  values  for  these  parameters  are  listed  in 
sections  3.41  LEEDR  Inputs  and  3.42  HELEEOS  Inputs. 

A  mid-latitude  climate  was  selected  for  the  Air-to-Ground  engagement 
scenario  modeled.  This  selection  is  based  upon  subject  matter  expert  input  regarding 
countries  of  interest  to  the  US  Air  Force  having  mid-latitude  climates.  Dayton,  Ohio, 
was  selected  as  the  location  for  the  scenario  modeled  in  this  thesis  due  to  its  mid¬ 
latitude  location.  As  seen  in  Figure  14,  climates  tend  to  be  consistent  relative  to 
their  distance  from  the  equator. 
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Figure  14:  Monthly  mean  SST  calculated  from  the  gridded  GTSPP  data  from  1990  to 
2008  during  (top)  January  and  (bottom)  July  (Fiorino,  2008) 

The  response  variables  chosen  for  this  research  were  Power  in  Bucket  (PIB) 
(watts)  and  Average  Irradiance  (watts/cm  )  within  a  10  cm  diameter  bucket.  PIB  and 
Average  Irradiance  provide  the  amount  of  energy  per  cm  deposited  on  the  target. 
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While  these  parameters  alone  will  not  reflect  the  achieved  damage  to  target, 
however,  they  do  provide  a  basis  to  compare  the  performance  between  design 
points. 


3.62  Design  Factor,  Level,  and  Range  Selection 

Design  Factors:  For  an  Air-to-Ground  laser  weapon  engagement  there  are 
numerous  controllable  factors.  These  factors  relate  mostly  to  HEL  characteristics 
(power  level,  wavelength),  optics  specifications,  as  well  as  engagement  geometry 
(aircraft  flight  altitude  and  slant  range).  There  are  a  variety  of  ways  to  choose 
factors  to  control  in  a  test  or  experiment.  Using  author  judgment,  based  on  four 
years  of  modeling  laser  weapon  system  engagements  for  the  Directed  Energy 
Directorate,  in  which  numerous  sensitivities  and  trade-space  assessments  were 
completed,  the  design  factors  selected  include  laser  output  power,  aperture  size, 
beam  quality,  wavelength,  and  slant  range  (propagation  path,  or  range  from  aircraft 
to  target). 

Levels  and  Ranges:  Each  design  factor  requires  a  range  and  levels  to  be 
tested  (i.e.  Power  level  from  range  100kw-400kw,  test  at  3  levels,  lOOkw,  200kw, 
and  400kw).  Ideally,  the  rule  of  thumb  in  selecting  a  range  is  to  capture  three 
standard  deviations  (99.73%)  of  variation  in  the  response.  This  rule  is  based  on  the 
concept  that  you  want  to  capture  a  broad  enough  range  to  detect  a  difference 
between  levels,  yet  not  so  broad  that  only  the  extreme  cases  are  captured. 

Due  to  physical  weight  and  volume  limitations  of  what  a  Bl-B  aircraft  can 
support  for  a  laser  weapon  system,  the  range  for  HEL  power  was  kept  between 
lOOkW  and  400kW.  As  for  wavelength,  many  sensitivity  studies  have  been 
performed  to  narrow  in  on  which  are  the  best  to  propagate  through  atmosphere,  and 
those  that  are  near  1  pm  include:  1.03  pm,  1.045  pm,  and  1.064  pm  (Fiorino,  2011). 
The  aperture  size  is  also  limited  by  the  weight  and  volume  capacity  of  the  beam 
director  on  the  Bl-B  aircraft;  apertures  exceeding  70  cm  (diameter)  are  not  worth 
the  cost  in  weight  and  volume,  and  apertures  less  than  25  cm  are  not  large  enough  to 
achieve  desired  performance  results.  The  slant  ranges  selected  for  this  research  were 
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taken  from  the  ELLA  program  test  demonstration  requirements.  Table  1  displays  the 
design  factors  and  the  levels  and  ranges  in  which  they  are  varied  in  the  models. 


Table  1:  Design  Factors  -  Levels  and  Range  Varied 


DESIGN  FACTORS 

Levels 

Ranges 

A 

Beam  Quality 

3 

1 

1.5 

2 

1 

B 

Aperture  Diameter  (cm) 

3 

30 

50 

70 

C 

Wavelength  (pm) 

3 

1.0642 

1.045 

1.03 

D 

Slant  Range  (km) 

3 

11 

17 

25 

E 

Power  (kW) 

4 

100 

150 

250 

400 

3.63  Experimental  Design  Selection 

The  design  factor  levels  and  ranges  shown  in  Table  1  would  require  a  full,  mixed 
factorial  design  with  of  3  level(4  factor)  x  4  level*4  factor)  =  (34)(4)  =  (81  )(4)  =  324 
possible  combinations,  or  design  points.  Since  variability  is  in  the  HEL  engagement 
model,  replications  are  needed  to  help  provide  a  better  estimate  of  the  pure  error  in 
the  model,  as  well  as  provide  a  better  estimate  of  average  response.  Given  three 
replications  at  each  design  point  yields  324*3  replications  =  972  total  observations. 
A  fractional  design  provides  the  design  reduction  needed  while  still  allowing  for 
estimates  of  the  main  effects.  This  is  done  by  aliasing  in  the  half  fraction  factorial 
design  eliminating  the  ability  to  estimate  higher  order  interactions.  Implementing 
this  design  yields  (3  )(4  )  =  108  design  points.  With  three  replications,  this  yields  a 
total  of  324  total  observations.  The  final  experimental  design  is  provided  in 
Appendix  A:  Experimental  Design. 

3.7  Summary 

This  thesis  addresses  two  methodological  issues  new  to  HEL  modeling.  First,  it 
improves  predictive  capabilities  in  modeling  HEL  engagements  by  incorporating 
atmospheric  variations.  Second,  by  applying  DOE,  parameters  are  varied  in  factorial 
designs,  in  random  order,  and  with  replications,  which  provide  a  statistical  basis  to 
objectively  compare  design  points  and  make  valid  conclusions.  These  approaches 
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allow  insights  into  the  portion  of  performance  attributed  to  design  factors,  and  what 
portion  is  attributed  to  nuisance  factors. 
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IV.  Results  and  Analysis  of  Key  Design  Factors 


4.1  Experienced-Based  Expectations  of  the  Research 

The  design  factors  selected  for  the  experimental  design  were  selected  based  on 
prior  knowledge  that  they  are  key  performance  parameters  which  drive  HEL 
performance.  Although  these  factors  have  been  modeled  and  studied  extensively, 
they  typically  have  been  varied  in  a  one  factor  at  a  time  manner,  eliminating  insights 
to  relationships  and  interactions  between  parameters.  Most  HEL  modeling 
approaches  also  lack  stochastic  modeling  of  atmospheric  conditions.  This  chapter 
demonstrates  the  advantages  using  an  experimental  design  to  analyze  interactions 
and  quadratic  effects,  as  well  as  advantages  to  incorporating  noise  to  differentiate 
between  cause  and  effect  relationships. 

For  the  analysis,  it  was  assumed  the  best  HEL  system  design  for  the  Air-to- 
Ground  engagement  modeled  would  be  an  HEL  laser  with  400kW  power,  beam 
quality  of  1,  70  cm  aperture,  and  1 1  km  slant  range  to  target.  These  scenario 
parameters  were  based  on  the  idea  that  more  power  yields  a  greater  intensity,  beam 
quality  of  1  yields  the  tightest  beam  possible,  a  70  cm  aperture  will  magnify  the 
intensity  greater  than  smaller  sizes,  and  1 1  km  is  a  reasonably  close  engagement 
range,  enabling  a  shorter  distance  for  the  beam  to  propagate  through  the  atmosphere. 
The  following  sections  address  research  findings  and  provide  insights  into  best 
parameter  settings  suggested  by  the  experimental  data. 

4.2  Experimental  Design 

The  experimental  design  used  for  this  research  is  a  factorial  design  composed  of 
five  design  factors:  beam  quality,  aperture  size,  laser  wavelength,  slant  range,  and 
HEL  power.  Each  parameter  is  varied  at  three  levels,  with  the  exception  of  HEL 
power,  varied  at  four  levels  shown  in  Table  2. 
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Table  2:  Design  Factors  -  Levels  and  Range  Varied 


DESIGN  FACTORS 

Levels 

Ranges 

A 

Beam  Quality 

3 

1 

1.5 

2 

1 

B 

Aperture  Diameter  (cm) 

3 

30 

50 

70 

c 

Wavelength  (pm) 

3 

1.0642 

1.045 

1.03 

D 

Slant  Range  (km) 

3 

11 

17 

25 

E 

Power  (kW) 

4 

100 

150 

250 

400 

HELEEOS  is  used  to  generate  power  in  bucket  (PIB)  intensities  on  target,  based 
on  the  design  settings.  Nuisance  factors,  such  as  absorption,  scattering,  turbulence, 
and  platform  jitter  are  also  modeled.  Absorption  and  scattering  effects  are  modeled 
using  LEEDR,  which  takes  real  METAR  observations  from  a  geographic  location 
(Dayton,  OH),  interpolates  upper  air  conditions.  These  conditions  are  used  to 
calculate  absorption  and  scattering  effects  by  percent  transmittance  for  the  modeled 
laser.  Turbulence  was  calculated  within  HELEEOS,  and  multiplied  by  a  random 
multiplier  from  a  lognormal  distribution  (p  =  0.22,  g= 0.7)  to  replicate  the  stochastic 
nature  of  turbulence.  Jitter,  a  platform  vibration  interference,  was  modeled  as  a 
random  variable  as  well.  Platform  jitter  inputs  were  pulled  from  a  normal 
distribution  (p=l,  g= 0.2).  The  distributions  for  turbulence  and  jitter  were  provided 
by  subject  matter  experts  in  the  Directed  Energy  modeling  community  (Fiorino  and 
Bartell,  2011). 

The  experimental  design  is  located  in  Appendix  B  and  C.  Each  design  point  has  a 
unique  set  of  nuisance  effects,  making  the  response  a  random  variable.  Since  these 
variations  can  dilute  the  traceability  of  an  effect  on  a  response,  each  design  point  is 
replicated  three  times. 

Four  response  variables  are  produced  by  HELEEOS  and  collected  for  each  design 
point  tested.  These  response  variables  are  PIB  (in  Watts),  averaged  irradiance  (in 
Watts/cm2),  atmospheric  transmittance  (in  %),  and  a  thermal  blooming  distortion 
number.  PIB  is  used  for  statistical  analysis  and  to  interpret  effects  of  interest.  The 
objective  is  to  isolate  the  largest  sources  of  variation  caused  to  the  response 
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variables,  and  identify  the  dependencies  that  exist.  Sources  of  variation  are  due  to 
main  effects,  interactions  between  two  or  more  effects,  non-linear  effects,  and  error. 

4.21  Key  Aspects  to  a  Good  Model 

Statistical  tools  are  very  helpful,  however  they  are  based  on  statistical  principles 
that  must  be  valid  in  order  to  use  the  tools  to  make  statistical  conclusions. 

Model  Adequacy  -  Model  adequacy  is  achieved  by  the  satisfaction  of  three 
statistical  assumptions:  residuals  (difference  between  actual  and  predicted  values) 
are  independent,  with  zero  mean,  constant  variance  a,  and  are  normally  distributed. 

Model  Fit  -  An  empirical  model  is  a  linear  model  representation  of  a  system 
or  process.  “Lack-of-fit”  is  the  calculation  which  reflects  how  well  an  empirical 
model  fits  data.  Lack-of-fit  compares  estimates  of  error  to  residual  error  to 
determine  whether  significant  effects  are  left  out  of  the  model.  Reducing  lack  of  fit 
generally  involves  adding  effects  to  the  model,  such  as  interactions  or  nonlinear 
terms,  or  linearizing  the  response  using  some  transformation. 

Model  Significance  -Statistical  significance  for  an  effect  is  based  upon  the 
units  of  variations  explained  by  the  effect  in  comparison  to  error.  Mean  square 
captures  units  of  explained  variation,  while  as  a  function  of  the  dimensions  of  design 
space  considered.  The  ratio  of  mean  square  model  to  mean  square  error  is  called  an 
F-ratio  and  follows  an  F-distribution  when  the  model  effect  is  zero.  As  the  F-ratio 
becomes  large,  the  probability  of  the  variation  due  to  error  decreases  and  probability 
of  the  variation  due  to  the  model,  or  model  components,  increases.  These 
probabilities  are  called  p-values. 

If  assumptions  of  normality  of  residuals  and  constant  variance  are  not 
satisfied  for  a  given  model,  then  statistical  inferences  are  tenuous.  Often  in  the  real 
world  analysis,  non-linear  nuisance  factors  interfere  with  getting  “clean”  data, 
making  it  hard  to  fit  an  empirical  model  and  achieve  model  adequacy.  In  cases  such 
as  these,  data  can  still  be  analyzed,  and  although  statistical  inferences  cannot  be 
made,  practical  inferences  can  be  made.  Practical  inferences  are  typically 
conservative,  as  to  reflect  less  confidence  about  the  data.  An  assumption  can  be 


42 


made  regarding  F-ratios,  and  what  level  will  be  deemed  significant  because  the  F- 
ratio  is  really  the  ratio  of  variance  explained  by  the  model  component  to  model 
error.  It  is  appropriate  to  assume  a  large  F-ratio,  for  instance  three  times  the 
magnitude  of  the  error,  means  changes  in  our  response  are  due  to  something  other 
than  error.  Thus,  an  F-ratio  of  3  or  higher  is  deemed  to  have  practical  significance  in 
driving  system  performance  when  we  cannot  make  firm  statistical  statements. 

4.22  Full  Model  Results 

The  full  empirical  model  for  the  Air-to-Ground  engagement  captures  all 
possible  combinations  of  design  factors,  to  include  two-way  interaction  effects,  non¬ 
linear  effects,  and  main  effects.  This  model  design  factors,  or  regressors,  are  listed  in 
the  “source”  column  in  Table  3.  This  empirical  model  is  based  on  PIB  outputs  from 
HELEEOS.  Actual  PIB  values  and  other  response  variables  are  located  in  Appendix 
D.  All  variations  to  the  response  not  explained  by  the  effects  in  the  model  are 
considered  pure  error. 
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Table  3:  Parameter  Estimates 


Source 

Estimated 

Coefficient 

Standard 

Error 

Type  Effect 

Intercept 

434390.24 

78562.05 

- 

Beam  Quality 

-10148.42 

2607.779 

Main 

Aperture 

888.33868 

62.99037 

Wavelength 

-307392.9 

75234.95 

Slant  Range 

-6737.812 

189.2597 

Power 

200.39097 

11.35191 

Beam  Quality*Beam  Quality 

3668.9063 

8755.601 

Non-Linear 

Beam  Quality* Aperture 

417.03347 

162.181 

Interaction 

Aperture  *Aperture 

-1.470799 

5.521688 

Non-Linear 

Beam  Quality* Wavelength 

138639.7 

188452.1 

Interaction 

Aperture  *Wavelength 

-2798.504 

4631.632 

Interaction 

Wavelength  *  Wavelength 

-33803202 

7652839 

Non-Linear 

Beam  Quality*Slant  Range 

1298.4399 

474.4251 

Interaction 

Aperture  *  Slant  Range 

-18.51438 

11.27882 

Interaction 

Wavelength  *  Slant  Range 

-7357.662 

13082.3 

Interaction 

Slant  Range  *  Slant  Range 

360.14319 

45.70288 

Non-Linear 

Beam  Quality*Power 

35.773023 

24.13629 

Interaction 

Aperture  *Power 

3.3650923 

0.571072 

Interaction 

Wavelength  *Power 

-1975.067 

658.7468 

Interaction 

Slant  Range  *Power 

-22.87221 

1.70417 

Interaction 

Power  *  Power 

-0.487425 

0.110281 

Non-Linear 

This  full  model  was  not  found  adequate  in  the  statistical  assumptions. 
Residuals  are  fit  to  a  normal  distribution.  Figure  15  shows  a  relatively  decent  fit, 
with  the  exception  of  the  tails.  The  fit  is  evaluated  by  a  Shapiro-Wilk  “goodness-of- 
fit”  test,  and  generates  a  p-value  of  <.0001,  which  rejects  a  null  hypothesis  that 
residuals  are  normally  distributed.  Thus,  the  full  empirical  model  does  not  satisfy  the 
first  assumption  of  normality  of  residuals. 
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Figure  15:  Residuals  Evaluated  for  Fit  to  Normal  Distribution 

Figure  16  plots  residuals  versus  the  predicted  response.  The  distinct  cone  pattern 
indicates  a  non-constant  variance. 


Figure  16:  Residual  by  Predicted  Plot 


Eight  transformations  were  examined:  Box  Cox,  log,  square  root,  square, 
reciprocal,  exponential,  Arrhenius,  and  Arrhenius-inverse.  No  transformations 
rectified  the  residual  issues.  Non-significant  terms  are  also  removed  from  the  model, 
however  the  reduced  models  still  failed  to  satisfy  normality  of  residuals  and  a 
constant  variance. 

Since  model  adequacy  fails,  practical  inferences  are  made.  The  analysis  of 
variance,  in  Table  4,  shows  the  mean  square  of  the  model  versus  mean  square  of  the 
error.  A  model  F-ratio  of  1 13.8  (MS modei/MS error)  is  large  enough  to  imply  it  has 
practical  significance.  The  model  explains  113  times  more  of  the  response 
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variability  than  does  error.  With  this  much  variation  explained  by  the  model,  there 
are  important  terms  in  the  model. 

Table  4:  Analysis  of  Variance 


Source 

Degrees  of 
Freedom 

Sum  of 
Squares 

Mean 

Square 

F  Ratio 

Prob  >  F 

Model 

20 

7.5381e+l  1 

3.769e+10 

113.7988 

<.0001* 

Error 

303 

1.0035e+ll 

331203848 

Total 

323 

8.5417e+l  1 

Table  5  lists  the  effects  within  the  full  model,  along  with  the  units  of 
variation  of  PIB  they  explain.  Each  effect  element  of  the  model  consists  of  one 
degree  of  freedom.  Given  a  rule  of  thumb  that  a  F-ratio  higher  than  3  has  practical 
significance,  thirteen  of  the  twenty  factors  (bolded  in  table)  satisfy  this  condition 
(these  factors  also  have  small  p-values  indicating  statistical  signature  if  model 
adequacy  checks  passed).  Effects  of  most  interest  are:  slant  range,  HEL  power,  and 
Aperture  size.  An  interesting  observation  are  the  non-linear  relationships  with  PIB, 
such  as  power  and  slant  range,  which  also  explain  a  fairly  large  portion  of  PIB 
variance. 
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Table  5:  Parameter  Estimates  and  Contribution  to  Power  in  Bucket  (PIB) 


Source 

Estimated 

Coefficient 

Standard 

Error 

Sum  of 
Squares 

F  Ratio 

Prob  >  F 

Intercept 

434390.24 

78562.05 

Beam  Quality 

-10148.42 

2607.779 

5002643875 

15.1445 

0.0001* 

Aperture 

888.33868 

62.99037 

6.5698e+10 

198.8881 

<.0001* 

Wavelength 

-307392.9 

75234.95 

5514326286 

16.6935 

<.0001* 

Slant  Range 

-6737.812 

189.2597 

4.1866e+ll 

1267.423 

<.0001* 

Power 

200.39097 

11.35191 

1.0293e+ll 

311.6151 

<.0001* 

Beam  Quality*Beam  Quality 

3668.9063 

8755.601 

58002323.6 

0.1756 

0.6755 

Beam  Quality* Aperture 

417.03347 

162.181 

2184167058 

6.6121 

0.0106* 

Aperture  *  Aperture 

-1.470799 

5.521688 

23437258.3 

0.0710 

0.7901 

Beam  Quality*Wavelength 

138639.7 

188452.1 

178779336 

0.5412 

0.4625 

Aperture  *  Wavelength 

-2798.504 

4631.632 

120594590 

0.3651 

0.5462 

Wavelength  * Wavelength 

-33803202 

7652839 

6444876122 

19.5106 

<.0001* 

Beam  Quality*Slant  Range 

1298.4399 

474.4251 

2474301397 

7.4905 

0.0066* 

Aperture  *  Slant  Range 

-18.51438 

11.27882 

890092915 

2.6946 

0.1017 

Wavelength  *  Slant  Range 

-7357.662 

13082.3 

104485318 

0.3163 

0.5743 

Slant  Range  *Slant  Range 

360.14319 

45.70288 

2.0512e+10 

62.0959 

<.0001* 

Beam  Quality*Power 

35.773023 

24.13629 

725628346 

2.1967 

0.1393 

Aperture  *Power 

3.3650923 

0.571072 

1.147e+10 

34.7226 

<.0001* 

Wavelength  *Power 

-1975.067 

658.7468 

2969412978 

8.9893 

0.0029* 

Slant  Range  *Power 

22.87221 

1.70417 

5.9502e+10 

180.1317 

<.0001* 

Power  *Power 

0.487425 

0.110281 

6452926019 

19.5350 

<.0001* 

The  full  model  yields  an  R2  =  0.88,  which  means  roughly  88%  of  the 
variance  within  the  response  is  explained  by  the  empirical  model,  and  12% 
explained  by  error,  nuisance  factors,  or  insignificant  factors  grouped  in  the  error 
term.  Table  6  indicates  some  lack  of  fit  of  the  model  to  the  data;  however  with  the 
rule  of  thumb  of  F-ratio  being  larger  than  3,  it  does  not  have  practical  significance. 
The  F-ratio  for  lack  of  fit  is  quite  small.  The  large  degrees  of  freedom  for  pure  error 
make  the  F-test  somewhat  sensitive.  The  small  F-ratio  leads  to  accepting  the  full 
model,  discounting  the  lack  of  fit.  There  might  be  non-linear  effects  in  the  residual 
error  due  to  nuisance  factors  such  as  thermal  blooming;  this  is  examined  later. 
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Table  6:  Lack  of  Fit 


Source 

Degrees 

Freedom 

Sum  of  Squares 

Mean  Square 

F  Ratio 

Prob  >  F 

Lack  of  Fit 

75 

3.4595e+10 

461267121 

1.599 

0.0045* 

Pure  Error 

228 

6.576e+10 

288419876 

Total  Error 

303 

1.0035e+l  1 

4.23  Full  Model  With  Poor  Visibility  Conditions  Removed 
Influential  points  are  known  to  skew  data  distributions,  and  are  typically 
located  at  the  tails  of  a  normal  fit  (such  as  the  s  shaped  series  of  points  deviating 
from  the  normal  fit  in  Figure  15).  Suspect  points  were  evaluated  and  traced  back  to 
the  model  inputs  of  HELEEOS  and  LEEDR.  The  cause  of  the  influence  was 
successfully  traced  back  to  poor  atmospheric  visibility  conditions  of  less  than  16 
statue  miles.  These  influential  points  were  removed,  and  the  model  is  re-evaluated. 
The  model  listed  in  Table  7  captures  the  full  model,  with  extreme  visibility 
conditions  removed. 

Table  7:  Full  Model  without  Poor  Visibility  -  Parameter  Estimates 


Source 

Estimated  Coefficient 

Standard  Error 

Intercept 

456883.09 

52895.07 

Beam  Quality 

-9295.873 

1751.37 

Aperture 

857.69105 

42.34575 

Wavelength 

-326801.6 

50537.65 

Slant  Range 

-6837.294 

128.9379 

Power 

213.26772 

8.121139 

(Beam  Quality- 1.49)*(Beam  Quality- 1.49) 

1205.0169 

5983.174 

(Beam  Quality- 1 .49)*(Aperture-50.28) 

416.0535 

106.5034 

( Aperture-5  0 .28)*  ( Aperture-5  0 .28) 

-12.09237 

3.718925 

(Beam  Quality- 1 ,49)*(Wavelength-l  .05) 

109334.92 

127652.4 

(Aperture-50.28)*(Wavelength-1.05) 

-5076.473 

3105.392 

(Wavelength- 1 ,05)*(Wavelength- 1 .05) 

-29715285 

5101571 

(Beam  Quality- 1.49)*(Slant  Range- 17.73) 

1251.8943 

313.1371 

(Aperture-50. 28)*(Slant  Range- 17.73) 

-18.27814 

7.694775 

(Wavelength- 1.05)*(Slant  Range-17.73) 

342.44749 

8869.147 

(Slant  Range-17.73)*(Slant  Range- 17.73) 

377.97088 

30.59005 

(Beam  Quality- 1 ,49)*(Power-220.24) 

47.225295 

16.87139 

(Aperture-50.28)*(Power-220.24) 

3.3748452 

0.388284 

( W  avelength- 1.05)*  (Power-220 . 24) 

-2131.118 

456.1259 

(Slant  Range-17.73)*(Power-220.24) 

-24.38194 

1.200517 

(Power-220 . 24)  *  (Power-220 . 24) 

-0.390279 

0.074323 
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Figure  17  shows  that  the  residuals  from  the  updated  model  do  fit  a  normal 
distribution.  This  model  passes  a  Shapiro-Wilk  goodness  of  fit  test  with  a  p-value  of 
0.18,  thus  residuals  are  normally  distributed. 


Figure  17:  Normal  Distribution  or  Residuals  (with  Poor  Visibility  Conditions 

Removed) 

Figure  18  shows  the  model  residuals  versus  the  predicted  response.  The 
residuals  have  a  slight  pattern,  which  can  indicate  a  non-constant  variance. 
Transformations  are  examined,  and  a  square  root  transformation  of  the  response 
removes  this  pattern.  Figure  19  shows  the  residual  versus  predicted  response  after 
the  transformation. 
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Figure  18:  Residual  by  Predicted 
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Figure  19:  Residual  by  Predicted  (with  Square 
Root  Transform  on  Response) 


This  statistically  adequate  model  has  an  R2  value  of  0.96.  The  model  has  a 
significant  lack  of  fit  with  a  F-ratio  of  3.4,  however,  leverage  plots  of  effects  versus 
the  response  were  examined,  and  all  apeared  fairly  linear,  thus  the  lack  of  fit  is  likely 
due  to  non-linear  atmospheric  effects  captured  in  the  error  term  or  sensitivity  due  to 
the  high  number  of  degrees  of  freedom  for  pure  error.  Model  details  are  presented  in 
next  section  in  comparison  with  our  initial  model. 

4.24  Side-by-Side  Comparison  of  Models 

Table  8  compares  both  the  full  model  with  all  points  and  the  full  model  with 
the  poor  atmospheric  visibility  points  removed.  Practical  significance  is  used  to 
make  inferences  in  the  full  model  (with  all  observations),  and  statistical  significance 
is  used  to  interpret  the  full  model  with  selected  points  removed  (use  of  a  p-value). 
Nearly  all  terms  in  the  second  model  are  statistically  significant  at  the  0.05  level 
(asteriked  in  Table  8).  Significant  terms  are  in  bold.  In  comparison,  both  models 
agree  that  slant  range,  power,  aperture,  and  interactions  between  slant  range  and 
other  parameters  explain  the  majority  of  variation  over  other  parameters  in  the 
model.  However,  F-ratios  for  aperture2  and  wavelength  differ.  The  difference  in 
wavelength  significance  may  be  due  to  the  idea  that  if  poor  visibility  conditions 
exist,  it  does  not  matter  which  type  of  wavelength  propagates,  all  are  wiped  out. 
Whereas  if  good  weather  conditions  exist,  wavelength  will  have  an  influence  on 
HEL  propagation. 
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Table  8:  Model  Comparisons  -  With  and  Without  Poor  Visibility  Conditions 


Full  Model 

Full  Model  w/Points  Removed 

Source 

Sum  of 

Squares 

F  Ratio 

Sum  of 

Squares 

F  Ratio 

P- Value 

Slant  Range 

4.19E+1 1 

1267.423 

1317971.8 

3642.304 

<.0001* 

Power 

1.03E+1 1 

311.6151 

282437.6 

780.5353 

<.0001* 

Aperture 

6.57E+10 

198.8881 

224666.1 

620.8799 

<.0001* 

Slant  Range*Power 

5.95E+10 

180.1317 

81830.6 

226.1444 

<.0001* 

Slant  Range*Slant  Range 

2.05E+10 

62.0959 

25217.5 

69.6901 

<.0001* 

Aperture*Power 

1.15E+10 

34.7226 

13719.8 

37.9156 

<.0001* 

Power*Power 

6.453E+09 

19.535 

17920.8 

49.5253 

<.0001* 

W  avelength*  W  avelength 

6.445E+09 

19.5106 

14307.3 

39.5393 

<.0001* 

Wavelength 

5.514E+09 

16.6935 

24561.1 

67.8761 

<.0001* 

Beam  Quality 

5.003E+09 

15.1445 

16995.4 

46.968 

<.0001* 

W  avelength*Power 

2.969E+09 

8.9893 

5510.7 

15.2292 

<0.0001* 

Beam  Quality*Slant  Range 

2.474E+09 

7.4905 

2658.5 

7.3468 

0.0072* 

Beam  Quality* Aperture 

2.184E+09 

6.6121 

6361.8 

17.5813 

<.0001* 

Aperture* Slant  Range 

890092915 

2.6946 

3528.3 

9.7506 

0.0020* 

Beam  Quality*Power 

725628346 

2.1967 

3288.4 

9.0876 

0.0028* 

Beam  Quality* Wavelength 

178779336 

0.5412 

240.9 

0.6657 

0.4153 

Aperture  *  W avelength 

120594590 

0.3651 

318.6 

0.8805 

0.3489 

Wavelength* Slant  Range 

104485318 

0.3163 

1349.1 

3.7283 

0.0546 

Beam  Quality *B earn  Quality 

58002324 

0.1756 

352.2 

0.9735 

0.3247 

Aperture  *  Aperture 

23437258 

0.071 

6236.1 

17.234 

<.0001* 

Although  it  is  important  to  identify  and  understand  influential  points  and 
how  they  alter  results,  they  cannot  be  removed  from  the  model  without  justification. 
Even  though  it  is  impractical  for  lasers  to  be  tested  on  very  poor  visibility  days,  the 
initial  model  with  the  influential  points  is  used  to  conduct  analysis,  keeping  in  mind 
statistical  inferences  may  be  suspect,  but  practical  significance  can  be  applied. 

Had  a  deterministic  model  been  used  to  model  this  Air-to-Ground  engagement, 
there  would  be  no  variation  in  the  response.  A  stochastic  model,  that  involves 
nuisance  factors,  provides  a  basis  to  determine  if  an  effect  is  meaningful  to  the 
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response  it  generates.  A  stochastic  model  also  reflects  which  effects  are  likely 
obscured  in  a  live  test.  Design  of  experiments  in  modeling  and  simulation  can  be 
used  to  make  projections  for  tests,  or  more  effectively  and  efficiently  design  tests  to 
estimate  factors  of  interest. 

4.25  Response  Surface  of  Full  Model 
Varying  one  factor  at  a  time  during  a  test  allows  us  to  estimate  main  effects. 
Varying  multiple  factors  at  a  time  allows  us  to  estimate  interactions.  Response 
surface  methodology  allows  us  to  evaluate  any  non-linear  effects  that  may  exist 
within  a  model.  We  can  also  generate  graphical  plots  depicting  factor  influence  on 
responses  of  interest.  While  limited  to  just  two  factors  at  a  time,  the  collective 
examination  of  the  surfaces  reveals  tremendous  insight  into  the  multi-dimensional 
surface  that  describes  how  the  response  varies  as  a  function  of  factor  levels. 

In  the  full  model,  the  non-linear  terms  believed  to  have  practical 
significance,  (due  to  a  F-ratio  >3),  are  slant  range  ,  wavelength  ,  and  power  .  The 
interactions  terms  believed  to  have  practical  significance  are  slant  range*power, 
aperture  size*power,  wavelength*power,  beam  quality*slant  range,  and  beam 
quality*aperture  size.  The  response  surface  of  each  of  these  non-linear  and 
interaction  terms  are  evaluated.  Beam  Quality  is  unit-less,  aperture  size  is  in  cm 
diameter,  HEL  power  is  in  kilowatts,  slant  range  in  km,  wavelength  in  pm,  and  PIB 
in  watts.  Figures  20-22  show  the  non-linear  relationship  between  individual 
parameters  (slant  range,  wavelength  and  power)  and  their  response,  PIB.  These 
parameters  are  practically  significant  as  main  effects,  and  as  non-linear  effects. 
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Figure  20:  Response  Surface  of  Slant  Range2  vs.  PIB 


Figure  21:  Response  Surface  of  Wavelegth2  vs.  PIB 
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Figure  22:  Response  Surface  of  Power2  vs.  PIB 


Figures  23-27  show  all  response  surface  interactions  believed  to  have  practical 
significance  in  the  model.  The  non-linearity  is  likely  to  be  caused  by  the  way  each 
parameter  is  effected  by  thermal  blooming,  a  non-linear  nuisance  factor.  Figure  4 
shows  an  interaction  between  power  and  slant  range  having  a  non-linear  effect  on 
PIB. 
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Figure  23:  Response  Surface  of  Power*Slant  Range  vs.  PIB 


Figure  24  shows  the  non-linear  relationship  between  HEL  power  and  aperture 
size.  The  higher  the  HEL  power  level,  the  hotter  the  atmosphere  becomes  as  the 
beam  propagates  through  it,  thus  increasing  atmospheric  absorption  and  thermal 
blooming.  The  bigger  the  aperture,  the  more  focused  the  beam  is,  creating  more 
intensity  in  a  tighter  beam.  Given  the  correlation  between  these  two  parameters  on 
beam  intensity  during  propagation,  the  relationship  makes  sense,  as  well  as  the  non¬ 
linear  influence  of  thermal  blooming. 
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Figure  24:  Response  Surface  of  Power* Aperture  vs.  PIB 


Figure  25  shows  the  response  surface  of  power  and  wavelength  versus  PIB. 
Wavelength  does  influence  the  speed  in  which  a  beam  propagates  through  an 
atmospheric  medium,  and  larger  wavelengths  tend  to  suffer  greater  beam  loss  due  to 
absorption.  Power  on  the  other  hand  has  a  cost-benefit  relationship  with  PIB,  where 
the  higher  the  power  the  more  intensity  on  target.  Higher  power  also  increases 
thermal  blooming,  which  causes  loss  to  PIB. 


Figure  25:  Response  Surface  of  Power*Wavelength  vs.  PIB 

Figure  26  shows  the  interaction  between  slant  range  and  beam  quality  as  it 
effects  PIB.  Since  these  parameters  are  not  highly  dependent  on  thermal  blooming, 
there  is  very  little  curvature  seen. 


Figure  26:  Response  Surface  of  Slant  Range*Beam  Quality  vs.  PIB 
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Figure  27  shows  the  response  surface  between  aperture  size  and  beam  quality 
vs.  PIB.  Apertures  cause  a  more  focused  beam,  whereas  beam  quality  relates  to  how 
spread  out  the  beam  is;  tighter  is  better.  The  aperture  focuses  a  beam  on  target,  and 
beam  quality  can  have  the  effect  of  defocusing  a  beam,  which  would  be  the  same 
effect  as  making  the  aperture  smaller.  These  two  parameters  play  against  one 
another  during  trade  studies. 
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Figure  27:  Response  Surface  of  Aperture  Size*Beam  Quality  vs.  PIB 

The  cost-benefit  relationships  between  parameters  is  clearly  complex,  and 
interpretations  are  hard  to  do  without  extensive  knowledge  of  atmospheric  and  HEL 
physics.  Had  these  interactions  and  non-linear  effects  not  been  included  in  the 
model,  they  would  have  been  mistakenly  been  captured  in  error  thus  obscuring  other 
effects.  Given  these  non-linear  effects  play  a  significant  role  in  HEL  modeling, 
analysis  conducted  without  incorporating  their  effect  may  be  misleading. 

4.26  A  look  at  Thermal  Blooming 

One  of  the  response  variables  collected  from  HELEEOS  was  a  thermal  blooming 
distortion.  An  empirical  model  is  examined  with  the  full  model  (all  main, 
interaction,  and  non-linear  effects),  but  with  thermal  blooming  as  a  response. 
Although  the  residuals  fail  both  the  assumption  of  normality  and  constant  variance, 
an  F-ratio  practical  significance  can  be  used  to  interpret  the  model.  Table  9  shows 
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that  power  and  aperture  size  have  the  greatest  effect  on  thermal  blooming,  based  on 
F-ratios  far  greater  than  3. 

Table  9:  Parameter  Effects  in  Relation  to  Thermal  Blooming 


Term 

Estimate 

Std  Error 

F 

Ratio 

Contribution  to 
Variation  in  Response 

Prob>|t| 

Power 

0.965199 

0.069373 

193.57 

>  i 

<.0001* 

Aperture 

2.712575 

0.38494 

49.66 

i - 1  - 1 

<.0001* 

Slant  Range 

7.064078 

1.156584 

37.3 

i 

<.0001* 

(Aperture-50)*(Power-225) 

0.014917 

0.00349 

18.27 

i 

<.0001* 

(Wavelength-1 .05)*(Wavelength-1 .05) 

182943.8 

46767.24 

15.30 

l  M 

0.0001* 

(Aperture-50)*(Slant  Range-17.7) 

0.195441 

0.068926 

8.04 

I  M 

0.0049* 

(Slant  Range-1 7. 7)*(Power-225) 

0.027275 

0.010414 

6.86 

i  M 

0.0093* 

(Wavelength-1 .05)*(Slant  Range-17.7) 

200.0598 

79.94723 

6.26 

I  ■ 

0.0129* 

Wavelength 

856.6778 

459.768 

3.47 

1  i  ■  1 

0.0634 

(Wavelength-1 .05)*(Power-225) 

7.255168 

4.025665 

3.24 

1  i  ■  1 

0.0725 

(Beam  Quality-1. 5)*(Power  (kW)-225) 

0.231795 

0.147499 

2.47 

1  i  ■>  1 

0.1171 

(Beam  Quality-1. 5)*(Slant  Range-17.7) 

-3.79111 

2.899257 

1.71 

1  I  ■  I  1 

0.1920 

(Slant  Range-1 7. 7)*(Slant  Range-17.7) 

-0.276393 

0.279295 

0.98 

1  Hi  1 

0.3232 

(Aperture-50)*(Wavelength-1.0464) 

-27.33041 

28.30435 

0.93 

1  Hi  1 

0.3350 

(Apertu  re-50  )*(  Aperture-50) 

-0.02869 

0.033744 

0.72 

1  Hi  1 

0.3959 

(Beam  Quality-1 ,5)*(Wavelength-1 .05) 

773.8866 

1151.649 

0.45 

1  ill  1 

0.5021 

(Power-225)*(Power-225) 

0.000359 

0.000674 

0.28 

1  ill  1 

0.5943 

(Beam  Quality-1. 5)*(Aperture-50) 

0.462790 

0.991104 

0.21 

1  ill  1 

0.6409 

(Beam  Quality-1. 5)*(Beam  Quality-1.5) 

14.88194 

53.50633 

0.07 

1  Ml  1 

0.7811 

Beam  Quality 

-0.160628 

15.93639 

0.0001 

1  i  1  i  1 

0.9920 

4.3  Optimal  System  Design  &  Test  Design  for  the  Specified  Mission  Scenario 

The  highly  non-linear  response  surface  was  found  to  have  a  saddle  point 
structure.  Thus,  using  the  canonical  analysis  component  of  RSM  did  not  yield  an 
optimal  design  setting  within  the  factor  space  considered.  A  nonlinear  constrained 
optimization  problem  was  solved  using  LINGO.  The  objective  is  to  maximize  PIB 
by  finding  the  combination  of  settings  that  yield  greatest  intensity  on  target.  The 
following  constraints  are  use  to  bound  the  solution  within  the  design  space. 

1)  1  <  Beam  Quality  <  2 

2)  30  cm  <  Aperture  Size  <  70  cm 

3)  1.03  pm  <  Wavelength  <  1.0642  pm 

4)  11  km  <  Slant  Range  <  25  km 

5)  1 00  kW  <  HEL  Power  <  400  kW 
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Table  10  shows  the  solution  output  from  LINGO,  achieving  a  maximum  PIB 
of  171,840.9  Watts.  Note,  this  may  not  be  a  unique  optimal  solution. 

Table  10:  Solution  to  Design 


Variable 

Solution 

Units 

Beam  Quality 

2 

- 

Aperture  Size 

70 

cm  (diameter) 

Wavelength 

1.03 

|um 

Slant  Range 

11 

Km 

HEL  Power 

400 

kW 

When  in  a  vacuum,  beam  quality  is  best  at  1 ,  however  it  appears  when  in  the 
company  of  other  parameters  and  atmospheric  variations,  that  value  is  not  ideal.  A 
larger  aperture  size  will  typically  yield  a  tighter,  smaller,  more  focused  beam  on 
target.  We  identified  a  possible  relationship  between  aperture  and  beam  quality;  it 
may  be  these  parameters  in  combination  make  PIB  best  achievable  when  beam 
quality  is  1  and  aperture  size  is  at  its  largest.  Smaller  wavelengths  are  known  to  be 
less  effected  by  absorption  and  scattering,  due  to  their  faster  travel  time  through  the 
atmosphere,  and  lower  index  of  refraction.  Lower  wavelengths  can  be  chosen  to 
reduce  absorption  and  scattering  effects,  allowing  other  parameters  that  do  cause 
absorption  and  scattering,  like  power,  to  be  set  higher.  Higher  powers  are  always 
more  affected  by  absorption,  scattering,  and  turbulence  effects,  however  it  is 
typically  worth  the  price.  A  laser  beam  may  spread,  bend,  get  absorbed  by  the 
atmosphere,  etc.,  but  if  enough  of  the  intensity  survives  despite  losses  along  the  way, 
it  could  still  cause  severe  damage  to  a  target  with  what  remains.  This  appears  to  be 
the  case  for  the  solution  found.  A  slant  range  of  1 1  km  is  not  surprising,  given  the 
shorter  distance  a  beam  has  to  propagate,  the  less  atmospheric  effects  encountered 
along  the  way. 

4.4  Summary 

Even  without  satisfying  normality  of  residuals  and  constant  variance  of  the  full 
empirical  model  of  the  Air-to-Ground  engagement,  in  a  practical  sense,  inferences 
can  be  made  regarding  parameters  significant  in  explaining  variations  to  PIB.  After 
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removing  select  influential  points  associated  with  extreme  atmospheric  visibility 
conditions,  normality  of  residuals  and  constant  variance  was  achieved.  In  a  practical 
sense,  HEL  test  would  not  be  conducted  on  days  with  poor  visibility,  however, 
capturing  poor  weather  days  to  modeling  can  provide  valuable  insights  to  system 
limitations. 
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V.  Conclusions  and  Recommendations 


5.1  Summary  of  Key  Contributions 

Two  key  contributions  were  made  by  this  research:  applying  DOE  and  RSM  to 
modeling  an  HEL  weapon  system  engagement,  and  incorporating  atmospheric 
variation  into  performance  modeling,  enabling  objective  inferences  of  significant 
effects  to  be  made. 

The  application  of  DOE  is  prevalent  in  live  testing,  however  this  research  shows 
it  can  effectively  and  efficiently  be  applied  to  modeling  and  simulation  of 
conceptual  or  existing  systems.  Modeling  and  simulation  provides  a  cost  effective 
and  resource  efficient  alternative  to  live  testing,  allowing  system  parameter 
relationships  and  key  drivers  of  system  performance  to  be  assessed  with  high 
confidence,  without  ever  conducting  a  live  test.  The  experimental  factorial  test 
design  used  in  this  thesis  took  five  factors  and  varied  them  at  different  levels 
simultaneously,  allowing  not  only  main  effects  to  be  analyzed,  but  also  interactions 
and  nonlinear  effects.  Results  found  that  many  interactions  and  nonlinear  effects  had 
both  practical  and  statistical  significance,  which  suggest  evidence  that  these 
relationships  drive  performance,  and  it  is  important  they  be  modeled. 

Nuisance  factors  are  modeled  stochastically  in  this  research,  which  enables 
residual  analysis  to  be  conducted.  This  is  done  by  incorporating  actual  weather 
observations  from  meteorological  reports,  varied  turbulence,  and  varied  jitter  into 
the  HEL  propagation  model.  Each  factorial  design  point  is  ran  three  times 
(replicated),  with  these  effects  being  varied  for  each  run.  There  are  two  advantages 
to  modeling  a  stochastic  nuisance  factors:  first,  it  captures  variations  in  system 
performance  as  a  function  of  atmospheric  conditions  and  platform  jitter,  and  second, 
enables  us  trace  units  variation  of  the  response  back  to  design  factors  of  interest. 

5.2  Key  Findings 

Residuals  from  the  full  empirical  model  (which  is  composed  of  main, 
interaction,  and  non-linear  effects),  were  analyzed  and  failed  to  be  normally 
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distributed  with  constant  variance.  Statistical  inferences  could  not  be  made  from  this 
model.  However,  given  a  factor  explained  three  times  the  magnitude  of  variation  to 
the  response  as  error,  the  factor  has  practical  significance,  as  it’s  highly  unlikely 
units  of  variation  that  large  are  caused  by  error. 

The  source  of  influential  points  were  assessed  and  traced  back  to  METAR 
observations  which  included  very  poor  atmospheric  visibility  observations. 
Observations  with  visibility  less  than  16  statute  miles  had  a  severe  effect  on  HEL 
beam  propagation.  These  influential  points  were  removed  from  the  model,  and  a 
new  empirical  model  was  assessed.  Residuals  were  normally  distributed  with 
constant  variance.  Since  model  adequacy  was  achieved,  statistical  inferences  could 
be  drawn. 

Table  1 1  compares  the  two  empirical  models  examined;  one  with  poor 
atmospheric  visibility  cases  included,  and  the  other  with  them  removed.  From  both 
models,  the  most  significant  contributors  are  slant  range,  HEL  power,  and  aperture 
size,  the  interaction  of  slant  range  and  power,  and  the  nonlinear  term  of  power 
squared.  These  three  parameters  explain  a  large  portion  of  the  variation  caused  to 
power  in  bucket.  The  actual  experimental  design  with  associated  power  in  bucket 
values  are  listed  in  appendix  D. 
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Table  11:  Model  Comparisons  -  With  and  Without  Poor  Visibility  Conditions 


Full  Model 

Full  Model  w/Points  Removed 

Source 

Sum  of 

Squares 

F  Ratio 

Sum  of 

Squares 

F  Ratio 

Value 

Slant  Range 

4.19E+1 1 

1267.423 

1317971.8 

3642.304 

<.0001* 

Power 

1.03E+1 1 

311.6151 

282437.6 

780.5353 

<.0001* 

Aperture 

6.57E+10 

198.8881 

224666.1 

620.8799 

<.0001* 

Slant  Range*Power 

5.95E+10 

180.1317 

81830.6 

226.1444 

<.0001* 

Slant  Range*Slant  Range 

2.05E+10 

62.0959 

25217.5 

69.6901 

<.0001* 

Aperture*Power 

1.15E+10 

34.7226 

13719.8 

37.9156 

<.0001* 

Power*Power 

6.453E+09 

19.535 

17920.8 

49.5253 

<.0001* 

W  avelength*  W  avelength 

6.445E+09 

19.5106 

14307.3 

39.5393 

<.0001* 

Wavelength 

5.514E+09 

16.6935 

24561.1 

67.8761 

<.0001* 

Beam  Quality 

5.003E+09 

15.1445 

16995.4 

46.968 

<.0001* 

W  avelength*Power 

2.969E+09 

8.9893 

5510.7 

15.2292 

0.0001* 

Beam  Quality*Slant  Range 

2.474E+09 

7.4905 

2658.5 

7.3468 

0.0072* 

Beam  Quality* Aperture 

2.184E+09 

6.6121 

6361.8 

17.5813 

<.0001* 

Aperture* Slant  Range 

890092915 

2.6946 

3528.3 

9.7506 

0.0020* 

Beam  Quality*Power 

725628346 

2.1967 

3288.4 

9.0876 

0.0028* 

Beam  Quality* Wavelength 

178779336 

0.5412 

240.9 

0.6657 

0.4153 

Aperture  *  W avelength 

120594590 

0.3651 

318.6 

0.8805 

0.3489 

Wavelength* Slant  Range 

104485318 

0.3163 

1349.1 

3.7283 

0.0546 

Beam  Quality *B earn  Quality 

58002324 

0.1756 

352.2 

0.9735 

0.3247 

Aperture  *  Aperture 

23437258 

0.071 

6236.1 

17.234 

<.0001* 

The  factors  are  ordered  by  the  size  of  associated  F-ratios.  The  two  models  order 
the  factors  of  significance  in  the  same  order,  up  until  to  the  13th  effects, 
Aperture*Slant  Range.  Main,  interaction,  and  nonlinear  effects  depict  significance, 
thus  RSM  is  used  to  analyze  the  response  surface.  Nonlinear  and  interaction  effects 
of  significance  listed  in  Table  1 1  were  examined.  Justifications  for  these  nonlinear 
relationships  are  likely  due  to  thermal  blooming  effects.  The  full  empirical  model 
was  assessed  using  thermal  blooming  as  a  response,  and  the  three  largest 
contributors  to  variation  in  thermal  blooming  were  power,  aperture  size,  and  slant 
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range.  These  three  factors  had  the  most  non-linear  and  interactions  significance  as 
seen  in  the  full  model,  when  using  PIB  as  response. 

Response  surface  analysis  was  used  for  this  research  and  unveiled  many 
interactions  and  non-linear  effects  that  exist  among  the  design  factors  selected. 
Capturing  these  effects  within  an  empirical  model  allows  us  to  better  estimate  and 
predict  HEL  performance. 

5.3  Caveats  on  Research 

HEELEOS  has  not  formally  been  verified,  validated,  and  accredited,  however  it 
is  an  HEL  propagation  model  widely  accepted  and  used  across  DoD  Joint  Services 
(Army,  Navy,  and  Air  Force)  for  Directed  Energy  Modeling  and  Simulation.  It  is 
often  used  in  conjunction  with  the  wave  optics  code,  WaveTrain,  to  which  it  is 
anchored.  In  regards  to  the  accuracy  of  METAR  data,  reports  were  collected  from 
two  sources  and  compared.  Both  sources  captured  identical  observations  for  Dayton, 
OH,  the  geographic  location  selected  for  this  research. 

5.4  Recommendations  for  Future  Work 

DOE  is  not  just  a  methodology  used  for  system  level  modeling.  HEL  systems  are 
highly  complex,  and  DOE  applications  at  the  sub-system  level  could  provide 
valuable  insights  about  cost-benefit  relationships  in  the  form  of  weight  and  volume 
versus  performance  gain.  These  relationships  were  never  examined  in  this  thesis,  but 
would  play  a  very  important  role  in  the  function  and  design  of  any  laser  weapon 
system. 

A  follow  on  to  this  research  could  examine  the  empirical  model  based  on  actual 
HEL  tests.  Conclusions  based  on  RSM  could  be  compared  to  model  and  simulation 
results.  This  iterative  process  could  help  improve  the  predictive  capability  of  current 
HEL  models. 

5.5  Implications  for  Directed  Energy  Testing 

HELEEOS  is  an  accepted  credible  model.  We  found  strong  nonlinear  effects 
between  the  factors  controlled  and  the  response  of  interest.  A  one-factor-at-a-time 
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(OF AT)  test  would  not  have  been  able  to  estimate  the  nonlinear  model.  Those 
nonlinear  effects  would  have  been  left  in  error,  thus  overstating  error,  and  obscuring 
the  results.  Live  testing  in  the  DE  domain  should  consider  moving  away  from 
OF  AT  and  adapt  DOE  as  a  methodology  for  achieving  greater  efficiency  and 
effectiveness  in  test  by  actually  modeling  the  nonlinear  response  function. 
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Appendix  A.  34'1*41  Fractional  Experimental  Design 


Below  is  the  341*41  Fractional  Experimental  Design.  This  design  is  replicated  3 
times  with  each  model. 


341*41  Experimental  Design  with  108  Design  Points 

Order 

Beam  Quality 

Aperture  (cm) 

Wavelength  (jum) 

Slant  Range  (km) 

Power  (kW) 

1 

1 

70 

1.045 

11 

250 

2 

2 

30 

1.064 

17 

400 

3 

1 

70 

1.064 

25 

150 

4 

1 

30 

1.064 

17 

250 

5 

2 

30 

1.045 

11 

250 

6 

1.5 

50 

1.030 

17 

250 

7 

1 

30 

1.030 

25 

100 

8 

2 

70 

1.030 

11 

400 

9 

2 

30 

1.064 

17 

150 

10 

1 

30 

1.030 

11 

250 

11 

1 

30 

1.045 

25 

100 

12 

1.5 

30 

1.064 

25 

100 

13 

1.5 

50 

1.045 

17 

150 

14 

1 

30 

1.064 

17 

150 

15 

1 

50 

1.045 

11 

250 

16 

1.5 

30 

1.030 

11 

400 

17 

1.5 

70 

1.045 

25 

150 

18 

2 

70 

1.064 

25 

400 

19 

1.5 

50 

1.045 

17 

150 

20 

1.5 

70 

1.045 

17 

250 

21 

1 

70 

1.030 

17 

250 

22 

1 

50 

1.030 

11 

400 

23 

1.5 

30 

1.045 

25 

150 

24 

1.5 

30 

1.045 

25 

250 

25 

1.5 

50 

1.064 

11 

250 

26 

2 

50 

1.045 

25 

250 

27 

1 

50 

1.045 

11 

400 

28 

2 

50 

1.030 

25 

400 

29 

1 

30 

1.064 

17 

100 

30 

1.5 

50 

1.030 

11 

100 

31 

1 

30 

1.045 

11 

400 

32 

1 

30 

1.064 

25 

250 

33 

1.5 

50 

1.064 

11 

150 

34 

2 

70 

1.030 

17 

100 

35 

1 

70 

1.030 

11 

100 

36 

1 

30 

1.045 

11 

150 

37 

2 

30 

1.045 

17 

250 

38 

2 

50 

1.045 

25 

250 

39 

1.5 

50 

1.064 

25 

250 
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Order 

Beam  Quality 

Aperture  (cm) 

Wavelength  (jum) 

Slant  Range  (km) 

Power  (kW) 

40 

1.5 

30 

1.064 

25 

100 

41 

1.5 

70 

1.045 

25 

400 

42 

1 

50 

1.045 

25 

100 

43 

2 

30 

1.045 

17 

150 

44 

2 

70 

1.064 

11 

100 

45 

1.5 

70 

1.045 

11 

100 

46 

2 

50 

1.030 

17 

150 

47 

2 

50 

1.045 

11 

150 

48 

1 

70 

1.045 

17 

100 

49 

2 

70 

1.064 

25 

100 

50 

1 

70 

1.045 

17 

400 

51 

1.5 

50 

1.030 

25 

150 

52 

2 

70 

1.064 

25 

150 

53 

1.5 

30 

1.064 

11 

400 

54 

1 

70 

1.030 

11 

150 

55 

2 

30 

1.045 

25 

400 

56 

1 

50 

1.030 

25 

100 

57 

2 

70 

1.045 

11 

150 

58 

1 

70 

1.064 

11 

150 

59 

2 

30 

1.045 

11 

100 

60 

2 

30 

1.045 

25 

400 

61 

1 

50 

1.045 

17 

100 

62 

2 

50 

1.064 

25 

100 

63 

1 

30 

1.030 

25 

250 

64 

2 

70 

1.030 

11 

250 

65 

2 

30 

1.030 

11 

150 

66 

1.5 

30 

1.045 

17 

100 

67 

2 

70 

1.030 

25 

150 

68 

2 

70 

1.030 

11 

250 

69 

1 

70 

1.045 

25 

150 

70 

1.5 

30 

1.030 

11 

150 

71 

2 

50 

1.064 

17 

150 

72 

2 

30 

1.064 

11 

100 

73 

1 

30 

1.030 

17 

400 

74 

1 

50 

1.064 

17 

400 

75 

1 

50 

1.064 

17 

150 

76 

2 

70 

1.064 

11 

400 

77 

1.5 

30 

1.064 

11 

150 

78 

1.5 

30 

1.030 

25 

150 

79 

1.5 

50 

1.045 

11 

100 

80 

2 

50 

1.064 

17 

400 

81 

1 

30 

1.064 

25 

250 

82 

1.5 

70 

1.064 

11 

250 

83 

1.5 

50 

1.064 

11 

250 

84 

2 

70 

1.030 

25 

250 

85 

2 

30 

1.030 

17 

250 

86 

1.5 

30 

1.030 

17 

400 

87 

1 

70 

1.030 

25 

100 
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Order 

Beam  Quality 

Aperture  (cm) 

Wavelength(jum) 

Slant  Range  (km) 

Power  (kW) 

88 

1.5 

70 

1.064 

25 

400 

89 

1.5 

50 

1.030 

17 

250 

90 

2 

50 

1.030 

17 

100 

91 

1.5 

70 

1.045 

25 

400 

92 

1.5 

70 

1.045 

17 

400 

93 

2 

50 

1.064 

17 

100 

94 

2 

70 

1.045 

17 

250 

95 

1.5 

70 

1.064 

17 

250 

96 

1 

50 

1.045 

11 

400 

97 

1.5 

30 

1.030 

17 

400 

98 

1 

50 

1.030 

25 

150 

99 

1.5 

70 

1.030 

17 

100 

100 

1.5 

50 

1.030 

25 

400 

101 

1 

50 

1.064 

25 

250 

102 

2 

50 

1.030 

25 

400 

103 

1 

70 

1.064 

17 

400 

104 

1 

50 

1.064 

11 

400 

105 

1 

70 

1.030 

17 

150 

106 

1.5 

30 

1.030 

11 

100 

107 

2 

50 

1.045 

11 

100 

108 

1.5 

70 

1.064 

17 

100 
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Appendix  B.  LEEDR  Varied  Inputs  (Experimental  Design  &  Nuisance  Factors) 


Below  is  the  table  of  data  used  to  enter  variations  in  design  points  and  nuisance  factors 
into  LEEDR.  There  were  108  design  points,  replicated  3  times.  Each  replication  called 


for  a  unique  atmospheric  profile. 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 


Design  Point  Column  Headings: 

BQ  =  Beam  Quality 

AP  =  Aperture  Diameter  (cm) 

WL  =  Wavelength  (pm) 


Replication  Column  Headings: 

A  =  Earth  Surface  Visibility  (km) 
B  =  Wind  at  Earth  Surface  (m/s) 
C  =  Wind  Direction  (0  =  North) 


SR  =  Slant  Range  (km)  D  =  Temp  @  Earth’s  Surface  (F) 

PW  =  HEL  Output  Power  (kW)  E  =  Dew  Point  @  Earth’s  Surface  (F) 


Design  Points 

Replication  1 

Replication  II 

Replication  III 

BQ 

AP 

WL 

SR 

PW 

A 

B 

C 

E 

A 

B 

C 

D 

E 

A 

B 

C 

E 

1 

70 

1.045 

11 

250 

16.1 

4.6 

100 

71.6 

46.4 

16.1 

5.1 

240 

89.6 

69.8 

16.1 

4.1 

260 

87.8 

77 

2 

30 

1.064 

17 

400 

16.1 

3.1 

230 

78.8 

60.8 

11.3 

4.1 

120 

69.8 

64.4 

16.1 

5.1 

350 

69.8 

53.6 

1 

70 

1.064 

25 

150 

16.1 

3.1 

200 

86 

71.6 

16.1 

2.6 

10 

80.6 

60.8 

16.1 

4.6 

250 

82.4 

69.8 

1 

30 

1.064 

17 

250 

16.1 

2.6 

70 

77 

60.8 

16.1 

3.6 

110 

73.4 

69.8 

16.1 

4.6 

20 

77 

53.6 

2 

30 

1.045 

11 

250 

16.1 

2.6 

40 

64.4 

60.8 

16.1 

2.1 

310 

77 

60.8 

16.1 

2.1 

80 

68 

68 

1.5 

50 

1.030 

17 

250 

16.1 

3.1 

100 

78.8 

66.2 

16.1 

3.1 

320 

75.2 

66.2 

16.1 

3.1 

290 

77 

69.8 

1 

30 

1.030 

25 

100 

16.1 

4.6 

180 

71.6 

66.2 

16.1 

0.0 

0 

78.8 

71.6 

9.7 

3.6 

240 

73.4 

73.4 

2 

70 

1.030 

11 

400 

16.1 

3.6 

240 

86 

69.8 

16.1 

3.6 

180 

82.4 

73.4 

16.1 

2.6 

250 

80.6 

69.8 

2 

30 

1.064 

17 

150 

16.1 

4.6 

220 

80.6 

68 

16.1 

3.6 

100 

80.6 

60.8 

16.1 

0.0 

0 

78.8 

62.6 

1 

30 

1.030 

11 

250 

16.1 

5.7 

320 

75.2 

62.6 

16.1 

4.6 

40 

80.6 

60.8 

16.1 

5.1 

210 

73.4 

69.8 

1 

30 

1.045 

25 

100 

16.1 

2.6 

0 

73.4 

50 

16.1 

7.2 

260 

89.6 

75.2 

16.1 

5.1 

360 

71.6 

51.8 

1.5 

30 

1.064 

25 

100 

16.1 

2.1 

210 

82.4 

62.6 

6.4 

3.6 

40 

66.2 

59 

16.1 

6.2 

230 

80.6 

59 

1.5 

50 

1.045 

17 

150 

16.1 

7.2 

300 

80.6 

69.8 

16.1 

5.1 

320 

68 

48.2 

16.1 

2.1 

150 

73.4 

69.8 

1 

30 

1.064 

17 

150 

16.1 

3.1 

40 

73.4 

51.8 

16.1 

4.6 

180 

80.6 

66.2 

16.1 

5.1 

290 

78.8 

68 

1 

50 

1.045 

11 

250 

16.1 

7.7 

280 

77 

51.8 

16.1 

2.6 

340 

78.8 

66.2 

16.1 

3.1 

60 

71.6 

57.2 

1.5 

30 

1.030 

11 

400 

9.7 

0.0 

0 

69.8 

66.2 

11.3 

4.1 

310 

86 

66.2 

11.3 

5.1 

230 

64.4 

64.4 

1.5 

70 

1.045 

25 

150 

6.4 

1.5 

270 

66.2 

62.6 

16.1 

3.6 

360 

77 

66.2 

16.1 

2.6 

110 

77 

57.2 

2 

70 

1.064 

25 

400 

161 

2.1 

30 

75.2 

50 

16.1 

4.6 

200 

91.4 

57.2 

16.1 

3.6 

10 

80.6 

64.4 

1.5 

50 

1.045 

17 

150 

16.1 

5.1 

140 

77 

55.4 

16.1 

3.1 

80 

78.8 

64.4 

16.1 

2.1 

90 

77 

62.6 

1.5 

70 

1.045 

17 

250 

16.1 

3.1 

240 

84.2 

68 

16.1 

1.5 

130 

69.8 

57.2 

16.1 

3.1 

300 

86 

77 

Design  Point 

Replication  1 

Replication  II 

Replication  III 
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21 

22 


26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 


BQ 

AP 

WL 

S 

1 

70 

1.030 

1 

1 

50 

1.030 

1 

1.5 

30 

1.045 

2 

1.5 

30 

1.045 

2 

1.5 

50 

1.064 

1 

2 

50 

1.045 

2 

1 

50 

1.045 

1 

2 

50 

1.030 

2 

1 

30 

1.064 

1 

1.5 

50 

1.030 

1 

1 

30 

1.045 

1 

1 

30 

1.064 

2 

1.5 

50 

1.064 

1 

2 

70 

1.030 

1 

1 

70 

1.030 

1 

1 

30 

1.045 

1 

2 

30 

1.045 

1 

2 

50 

1.045 

2 

1.5 

50 

1.064 

2 

1.5 

30 

1.064 

2 

1.5 

70 

1.045 

2 

1 

50 

1.045 

2 

2 

30 

1.045 

1 

2 

70 

1.064 

1 

1.5 

70 

1.045 

1 

2 

50 

1.030 

1 

2 

50 

1.045 

1 

1 

70 

1.045 

1 

2 

70 

1.064 

2 

1 

70 

1.045 

1 

1.5 

50 

1.030 

2 

2 

70 

1.064 

2 

1.5 

30 

1.064 

1 

1 

70 

1.030 

1 

Design  Points 

Replication  I 


Replication  SI 


Replication  ill 


BQ 

AP 

WL 

SR 

PW 

A 

B 

C 

D 

E 

A 

B 

C 

D 

E 

A 

B 

C 

D 

E 

55 

2 

30 

1.045 

25 

400 

16.1 

2.1 

280 

80.6 

69.8 

16.1 

5.1 

10 

73.4 

59 

16.1 

3.6 

210 

80.6 

66.2 

56 

1 

50 

1.030 

25 

100 

16.1 

3.6 

360 

78.8 

69.8 

16.1 

4.6 

10 

77 

50 

16.1 

3.1 

230 

82.4 

73.4 

57 

2 

70 

1.045 

11 

150 

16.1 

2.1 

310 

71.6 

68 

16.1 

2.6 

270 

80.6 

64.4 

11.3 

5.7 

220 

64.4 

64.4 

58 

1 

70 

1.064 

11 

150 

16.1 

2.6 

350 

75.2 

57.2 

16.1 

5.1 

50 

84.2 

59 

16.1 

4.1 

280 

71.6 

60.8 

59 

2 

30 

1.045 

11 

100 

16.1 

6.7 

330 

62.6 

55.4 

16.1 

5.1 

230 

86 

68 

16.1 

2.6 

110 

68 

44.6 

60 

2 

30 

1.045 

25 

400 

16.1 

4.1 

20 

77 

59 

16.1 

4.1 

60 

75.2 

48.2 

16.1 

0.0 

0 

84.2 

75.2 

61 

1 

50 

1.045 

17 

100 

16.1 

3.6 

190 

82.4 

64.4 

9.7 

5.1 

260 

75.2 

69.8 

16.1 

3.1 

320 

64.4 

57.2 

62 

2 

50 

1.064 

25 

100 

16.1 

4.1 

240 

84.2 

73.4 

16.1 

5.7 

320 

80.6 

50 

16.1 

4.6 

330 

71.6 

59 

63 

1 

30 

1.030 

25 

250 

11.3 

6.2 

230 

77 

64.4 

16.1 

3.6 

150 

84.2 

68 

8.0 

0.0 

0 

69.8 

69.8 

64 

2 

70 

1.030 

11 

250 

16.1 

3.1 

220 

68 

51.8 

9.7 

2.1 

270 

77 

71.6 

16.1 

5.7 

230 

80.6 

66.2 

65 

2 

30 

1.030 

11 

150 

16.1 

2.6 

40 

75.2 

53.6 

16.1 

3.1 

30 

80.6 

62.6 

16.1 

4.6 

100 

69.8 

51.8 

66 

1.5 

30 

1.045 

17 

100 

16.1 

4.1 

360 

84.2 

71.6 

16.1 

4.1 

320 

69.8 

53.6 

16.1 

3.1 

40 

73.4 

64.4 

67 

2 

70 

1.030 

25 

150 

16.1 

3.1 

340 

80.6 

71.6 

16.1 

3.1 

320 

77 

57.2 

16.1 

2.1 

0 

82.4 

66.2 

68 

2 

70 

1.030 

11 

250 

16.1 

5.1 

250 

78.8 

64.4 

16.1 

1.5 

100 

68 

68 

16.1 

4.6 

140 

71.6 

68 

69 

1 

70 

1.045 

25 

150 

16.1 

0.0 

0 

80.6 

64.4 

16.1 

5.1 

330 

71.6 

59 

16.1 

5.7 

110 

69.8 

64.4 

70 

1.5 

30 

1.030 

11 

150 

16.1 

6.2 

230 

86 

69.8 

16.1 

5.7 

280 

66.2 

50 

16.1 

4.1 

60 

71.6 

51.8 

71 

2 

50 

1.064 

17 

150 

16.1 

3.1 

250 

75.2 

66.2 

16.1 

4.1 

230 

78.8 

71.6 

16.1 

3.6 

240 

78.8 

66.2 

72 

2 

30 

1.064 

11 

100 

16.1 

4.1 

80 

80.6 

59 

16.1 

5.1 

270 

84.2 

73.4 

16.1 

2.6 

230 

71.6 

59 

73 

1 

30 

1.030 

17 

400 

16.1 

3.1 

260 

69.8 

55.4 

8.0 

3.1 

330 

62.6 

59 

16.1 

3.6 

340 

69.8 

53.6 

74 

1 

50 
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Appendix  C.  Turbulence  and  Jitter  Variable  Inputs  into  HELEEOS 


Below  all  108  design  points  are  listed  with  their  corresponding  turbulence  multiplier 
and  platform  jitter  inputs. 


Design  Point  Column  Headings:  Replication  Column  Headings: 

BQ  =  Beam  Quality  TB  =  Turbulence  Multiplier 

AP  =  Aperture  Diameter  (cm)  JR  =  Platform  Jitter  Input  (prad) 

WL  =  Wavelength  (pm) 

SR  =  Slant  Range  (km) 

PW  =  HEL  Output  Power  (kW) 
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0.8 
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0.7 

1.2 

9 

2 

30 

1.064 

17 

150 

1.0 

0.7 

1.4 

1.0 

1.0 

0.9 

10 

1 

30 

1.030 

11 

250 

0.6 

1.1 

0.4 

1.1 

1.6 

0.9 

11 

1 

30 

1.045 

25 

100 

1.5 

0.8 

2.1 

0.9 

0.2 

1.2 

12 

1.5 

30 

1.064 

25 

100 

1.8 

1.2 

0.3 

1.1 

0.8 

0.9 

13 

1.5 

50 

1.045 

17 

150 

0.5 

0.9 

1.0 

1.2 

1.0 

1.1 

14 

1 

30 

1.064 

17 

150 

2.3 

1.1 

2.7 

1.0 
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Appendix  D.  Design  Points  with  Associated  Response  Variables 


Below  is  the  table  of  data  with  108  design  points,  replicated  3  times,  and  the 
response  variables  collected  from  HELEEOS.  Responses  include  HEL  path 
transmittance,  thermal  blooming  effect,  average  irradiance,  and  power  in  bucket. 
Design  Point  Column  Headings:  Replication  Column  Headings: 


BQ  =  Beam  Quality 

AP  =  Aperture  Diameter  (cm) 

W  =  Wavelength  (pm) 

S  =  Slant  Range  (km) 

P  =  HEL  Output  Power  (kW) 


A  =  Thermal  Blooming  (km) 

B  =  Atmospheric  Transmittance  (km1) 
C  =  Power  in  Bucket  (Watts) 

D  =  Average  Irradiance  (Watts/cm  ) 
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AP 

P 

A 

B 

C 

D 
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2 
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30 
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2 

70 

400 
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0.77 

221852.70 
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0.67 
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0.70 
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30 
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0.75 
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30 
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0.61 

103960.90 
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30 
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264.06 
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30 
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0.75 

164188.22 

2091.57 

16 

1.03 

11 

1.5 

30 

400 

195.6 
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30 
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0.49 
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0.48 
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0.61 
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29 
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17 

1 

30 
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77.7 

0.67 
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396.29 

74.3 

0.55 

24838.30 

316.41 

61.1 

0.55 

26574.92 

338.53 

30 

1.03 

11 

1.5 

50 

100 

65.7 

0.74 

70807.18 

902.00 

72.0 

0.83 

77644.05 

989.10 
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0.17 
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206.18 

31 

1.045 

11 

1 

30 
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143.9 

0.86 
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2620.86 
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0.71 
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2269.27 
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0.75 

162686.21 

2072.44 

32 
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25 

1 

30 
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201.0 

0.37 
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182.4 

0.52 
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0.45 
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175.29 

33 
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50 
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83.0 

0.68 
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1172.14 
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0.70 

92646.16 

1180.21 

34 

1.03 

17 

2 

70 

100 
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0.55 
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0.75 
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619.81 

35 

1.03 

11 

1 

70 
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0.67 

67350.80 

857.97 

77.6 

0.67 
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855.90 

36 
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11 

1 

30 
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0.75 
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0.88 
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1411.59 

37 
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2 

30 
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39778.39 

506.73 
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587.48 
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0.59 
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503.03 
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1.045 
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458.19 
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0.49 
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32377.21 

412.45 
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Appendix  E.  Blue  Dart 

Why  is  it  important  to  model  atmospheric  variations  in  High  Energy  Laser  (HEL) 
propagation  modeling? 

High  Energy  Lasers  (HEL)  weapons  are  intriguing  weapons.  They  travel  at  the 
speed  of  light,  engage  targets  with  bullet-like  precision  from  extremely  long  ranges,  make 
little  noise  without  being  seen,  and  typically  leave  little  to  no  collateral  damage  behind. 

So  are  lasers  the  solution  for  which  we  have  been  looking?  Well,  aside  from  the  many 
advantages  listed,  they  are  not  “all  weather”  weapons.  This  likely  means  lasers  will 
always  be  used  in  combination  with  other  weapons,  as  they  may  be  useless  on  rainy  or 
poor  visibility  days.  However,  there  are  still  ways  in  which  we  can  try  to  maintain  laser 
performance  on  such  days. 

Atmospheric  effects  can  absorb,  scatter,  and  bend  light,  causing  a  laser  beam  to 
diminish  as  it  propagates.  These  effects  are  constantly  changing  as  a  function  of  a 
dynamic  atmosphere  with  temperature  and  density  differentials.  We  cannot  control  the 
atmosphere,  however,  we  can  attempt  to  develop  durable  HEL  weapon  designs  which  can 
withstand  a  variety  of  weather  conditions,  and  identify  altitudes  and  geometries  which 
have  the  least  negative  impact  on  laser  propagation.  So  how  do  we  figure  out  which 
designs  and  geometries  are  best?  Live  tests  can  yield  insights  to  best  system  designs  and 
engagement  geometries;  however,  since  HEL  tests  are  infrequent,  data  is  very  limited. 
Modeling  and  simulation  of  HEL  weapons  is  an  efficient  and  cost  effective  alternative  to 
live  tests.  Directed  Energy  Joint  forces  (Air  Force,  Army,  Navy)  are  extensive  users  of 
HEL  models  for  HEL  research  and  development  (R&D).  These  models  are  highly 
capable  and  helpful  when  assessing  conceptual  HEL  designs  or  enhancing  predictive 
modeling  capabilities  for  existing  HEL  weapons. 

One  limitation  of  HEL  models  addressed  in  this  research  is  the  deterministic  nature 
of  models  used.  This  means  the  atmosphere  is  modeled,  however  only  a  snap  shot  of  the 
atmosphere  in  time,  with  no  variation  through  time.  An  independent  repeat  of  one 
simulation  will  yield  identical  results  to  the  first,  which  is  unlike  a  repeat  of  a  live  test, 
which  will  yield  different  results  as  a  function  of  the  changing  atmosphere.  When  trying 
to  represent  a  realistic  environment  for  HEL  propagation,  stochastic  models  are  most 
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appropriate.  Stochastic  models  of  the  atmosphere  capture  the  entire  spectrum  of  weather 
conditions  seen  in  a  location  over  a  period  of  time.  These  conditions  are  pulled  at 
random,  to  simulate  a  randomly  varying  atmosphere. 

The  primary  objective  for  modeling  a  stochastic  atmosphere  in  this  research  was  to 
determine  HEL  designs  and  engagement  geometries  best  suited  for  varying  weather 
conditions.  In  other  words,  identify  which  laser  characteristics  are  most  influenced  by 
weather.  A  realistic  atmosphere  was  modeled  through  obtaining  real  weather  data  from 
meteorological  reports  (METARs),  and  incorporating  those  points  into  the  HEL  modeling 
process.  METARs  are  daily  reports  for  aviators  needing  to  know  ground  conditions 
(temperature,  dew  point,  visibility,  etc.)  in  multiple  geographic  locations  around  the 
globe.  These  observations  capture  variations  found  naturally  in  the  atmosphere,  and  in 
turn,  allow  us  to  estimate  how  an  HEL  system  would  perform  in  both  good  and  bad 
weather  conditions.  An  experimental  test  design  was  used  to  lay  out  the  sequence  of 
simulations  ran.  This  experimental  design  is  based  on  Design  of  Experiment  (DOE) 
methodology,  which  varies  multiple  factors  during  the  simulation,  in  order  to  see  the 
effect  of  interactions  that  exist  between  laser,  platform,  geometry,  and  atmospheric 
parameters. 

For  this  research,  an  Airborne  Bl-B  was  modeled,  equipped  with  an  HEL  weapon 
which  was  engaging  a  target  on  the  ground.  Results  found  that  different  HEL  weapon 
designs  modeled  each  do  perform  differently  given  different  weather  conditions.  And 
actually,  some  HEL  designs  diminished  right  away  as  a  result  of  the  poor  visibility  within 
the  atmosphere.  Non-linear  interactions  were  identified  from  the  HEL  model,  showing 
non-linear  relationships  between  laser  characteristics  and  intensity  on  target,  as  well  as 
non-linear  relationships  between  laser  characteristics  and  atmospheric  effects.  The  way  in 
which  the  atmospheric  data  was  incorporated  into  the  model,  and  the  experimental 
design,  allows  us  to  differentiate  between  a  performance  outcome  due  to  interferences, 
parameter  settings,  or  a  combination  of  both.  This  was  a  very  effective  model  for 
predicting  laser  weapon  performance. 

Modeling  HEL  weapons  is  not  only  effective  in  identifying  relationships  between 
parameters  in  a  complex  and  highly  non-linear  space,  but  it  can  also  be  effective  in 
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designing  live  tests.  Estimates  of  the  best  test  designs  can  be  determined  prior  to  tests, 
through  modeling  and  simulation.  Using  METAR  data  from  the  location  of  test  can  easily 
be  incorporated,  to  give  a  user  a  representative  model  of  the  range  of  atmospheric 
conditions  in  their  geographic  location. 
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